-- Logs begin at Wed 2022-06-29 21:43:03 UTC, end at Wed 2022-06-29 23:44:06 UTC. -- Jun 29 22:22:33.692791 dv-cinder-812685-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 22:22:33.699997 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 22:22:33.702032 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 22:22:33 2022] *** Jun 29 22:22:33.702032 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 22:22:33.702032 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 22:22:33.702032 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: nodename: dv-cinder-812685-13-iscsi Jun 29 22:22:33.702032 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: machine: x86_64 Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: clock source: unix Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: pcre jit disabled Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: detected number of CPU cores: 4 Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: current working directory: / Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: detected binary path: /usr/bin/uwsgi-core Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: your processes number limit is 47680 Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: your memory page size is 4096 bytes Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: detected max file descriptor number: 2048 Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: lock engine: pthread robust mutexes Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: thunder lock: enabled Jun 29 22:22:33.702381 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 22:22:33.703055 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 22:22:33.747700 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: Python main interpreter initialized at 0x5607266699c0 Jun 29 22:22:33.747700 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: python threads support enabled Jun 29 22:22:33.747700 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: your server socket listen backlog is limited to 100 connections Jun 29 22:22:33.747700 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: your mercy for graceful operations on workers is 90 seconds Jun 29 22:22:33.748048 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 22:22:33.748139 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: *** Operational MODE: preforking *** Jun 29 22:22:33.748436 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: *** uWSGI is running in multiple interpreter mode *** Jun 29 22:22:33.748436 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: spawned uWSGI master process (pid: 80032) Jun 29 22:22:33.748640 dv-cinder-812685-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 22:22:33.750200 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: spawned uWSGI worker 1 (pid: 80046, cores: 1) Jun 29 22:22:33.750200 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: spawned uWSGI worker 2 (pid: 80047, cores: 1) Jun 29 22:22:33.750200 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 22:22:39.166066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:22:39.166066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: from cryptography.utils import int_from_bytes Jun 29 22:22:39.166856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:22:39.166856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: from cryptography.utils import int_from_bytes Jun 29 22:22:39.166856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:22:39.166856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: from cryptography.utils import int_from_bytes Jun 29 22:22:39.167372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:22:39.167372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: from cryptography.utils import int_from_bytes Jun 29 22:22:39.215088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 22:22:39.215278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 22:22:39.215468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] command line args: [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 22:22:39.215733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 22:22:39.215910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ================================================================================ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 22:22:39.216024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 22:22:39.216163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] admin_token = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.216248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 22:22:39.216389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_dir = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.216538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] command line args: [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 22:22:39.216619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.216693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 22:22:39.216775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] config_source = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.216849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ================================================================================ {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 22:22:39.216925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] debug = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217073 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] admin_token = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] config_dir = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217572 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] config_source = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] debug = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.217911 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_config_append = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218642 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_dir = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.218986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219274 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_config_append = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219440 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_dir = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219759 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_file = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.219915 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220221 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.220896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221014 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221096 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.221998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.222129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.222213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.222395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.222994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223242 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223384 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] publish_errors = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.223995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224431 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] publish_errors = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224664 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.224986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] standard_threads = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_journal = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] standard_threads = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_json = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.225953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_stderr = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] use_syslog = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] use_journal = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.226791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] use_json = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] use_stderr = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.226935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] use_syslog = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.227121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:22:39.227360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.227974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228863 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.228976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229112 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229833 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.229944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230411 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.230905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231318 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.231881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232046 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232680 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.232992 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233366 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.233919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234061 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234369 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.234993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235572 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235697 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.235929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236044 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.236959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237634 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.237861 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238368 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.238970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.239987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.240965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241408 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.241887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.242852 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243801 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.243953 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244254 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244744 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244913 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.244995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245225 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245851 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.245929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246083 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246551 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246781 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.246859 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247333 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.247951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248186 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248265 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.248977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.249889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.250954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.external = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.251986 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.external = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.password = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] auth.token = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.252978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.password = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] auth.token = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253706 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253850 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.253928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.254886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255126 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.255981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.256946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257762 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.257932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.258976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259220 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259674 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259837 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.259916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260071 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.260884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261744 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.261986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262445 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.262918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263227 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263468 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263696 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.263930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264304 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.264878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.265995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.266923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.267919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268310 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268662 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.268897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.269065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.269652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.269840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.269919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270170 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270405 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.270847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271001 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.271924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272159 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.272979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.273099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.273214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.273316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.274679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.274760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.274834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.274906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.274906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275637 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.275952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276023 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.276931 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277392 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.277958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278599 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.278910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.279989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.280961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281435 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281515 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.281978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282131 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282598 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.282905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283141 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.283855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.284761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.285398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.285536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.285622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.285775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.285860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286007 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] role.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286318 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] role.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.286945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287913 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.287995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288241 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.288959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289605 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289685 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.289847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290819 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.290970 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291050 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291294 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.291933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292501 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.292970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293694 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.293920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294159 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294310 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.294853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295484 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.295972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296053 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296206 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.296941 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.297969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298192 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298579 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298869 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.298958 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299112 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.connection = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.299909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300610 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.300876 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.301953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302416 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302642 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.302950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.303100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.303188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.303302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 22:22:39.303386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:22:39.303483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 22:22:39.333983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.334163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.334272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.334353 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.334428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.334581 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.342789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.345761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.371168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.371398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.372147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.372380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.513344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.513520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.561819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.561990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.562080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.562229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.626651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.626874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.627129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.627351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.627566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.627778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.629191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.629494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.629795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.630044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.630251 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.630480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.653972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.654736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.665468 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.665729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678347 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.678891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679318 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80047) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.679729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80046) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:22:39.697186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.697391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:22:39.697724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.697808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.697923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:22:39.698021 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:22:39.698189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.698329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.698445 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.698527 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:22:39.698700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.698791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.698953 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.699035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.699267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.699521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.710446 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.710720 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.710986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.711114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.711261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.711387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.711653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.711928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.719558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.720424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.723298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.723577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.723714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.723864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.723987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.724971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725101 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725631 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.725894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.726029 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.726161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.726423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.752857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.753294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.754991 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.755262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.755426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.755702 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.760531 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.760806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.760991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.761202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.761285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.761640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.768526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.768761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.768889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.769214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.773858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.774141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.774237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.774426 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.774511 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.774707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.774800 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.774979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.775850 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.776031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.794270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.794535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.794620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.794807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.799027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.799366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.803281 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.803542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.803702 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.803832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.808684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.808959 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.812270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.812563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.815936 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.816751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.816856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817130 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.817981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.818163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.836817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.837095 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.837178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.837358 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.837454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.837615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.837700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.837893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.845471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.845792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.847174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.847474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.847556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.847791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.850688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.850966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.851235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.851320 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.851509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.851593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.851779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.851864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.852050 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.852347 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.865497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.865770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866130 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.866324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866408 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866610 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.866896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.867437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.868359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.868683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.868962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.869261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.887005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.887592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.890266 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.890883 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.893592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.894239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.895924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.896010 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.897606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.897877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.898069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.898153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.898344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.898619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.905582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.905994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.907190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.907684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.910502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.910794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.911048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.911186 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.911342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.911497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.911734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.912011 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.920563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.920846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.921122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.921263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.921394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.921660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.929482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80047) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.929756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80046) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:22:39.930294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.930943 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.931974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932800 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.932948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.933083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80047) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.933211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.933338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.933517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80046) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:22:39.971111 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607266699c0 pid: 80047 (default app) Jun 29 22:22:39.971601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607266699c0 pid: 80046 (default app) Jun 29 22:22:39.974515 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0acb-8576-4a0a-a56e-a20051313487 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:39.974807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0acb-8576-4a0a-a56e-a20051313487 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:39.975085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a0acb-8576-4a0a-a56e-a20051313487 None None] PATH_INFO: `/v3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:39.979240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jun 29 22:22:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:22:48.613781 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:48.614334 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:48.614334 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:48.618849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:22:48.624071 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:48.624509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:48.624654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:48.692562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: INFO dbcounter [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] Registered counter for database keystone Jun 29 22:22:48.713921 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG oslo_db.sqlalchemy.engines [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 22:22:48.720173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writer thread running {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 22:22:48.896164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG passlib.handlers.bcrypt [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80047) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 22:22:48.896536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG passlib.handlers.bcrypt [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80047) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 22:22:48.950739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:48.952321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:49.073213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 22:22:49.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:49.312480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: INFO dbcounter [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] Registered counter for database keystone Jun 29 22:22:49.331857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG oslo_db.sqlalchemy.engines [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 22:22:49.338136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writer thread running {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 22:22:49.455306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad056d-ee27-4c87-8bd0-abefc738fad4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:49.459413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd834971bff2f4ef9b259002b3b3122c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:49.460066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:49.460347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:49.460648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:49.468687 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:49.522383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: WARNING keystone.common.rbac_enforcer.enforcer [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 22:22:49.522720 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97808a3d-35c1-4aac-acac-987f00fdf32e admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:49.532525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 22:22:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 22:22:49.539193 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:49.554471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957829b-cfdc-4e06-9df9-d8448883c74a None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:49.558927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd834971bff2f4ef9b259002b3b3122c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:49.560052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:49.560343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:49.560667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] PATH_INFO: `/v3/projects/d834971bff2f4ef9b259002b3b3122c9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:49.562174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] RBAC: Authorizing `identity:get_project(project_id=d834971bff2f4ef9b259002b3b3122c9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:49.618396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 22:22:49.618738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ee1c6-b35e-4ef0-bcf0-a59be6b8541a admin admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:49.623387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jun 29 22:22:49 2022] GET /identity/v3/projects/d834971bff2f4ef9b259002b3b3122c9 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:22:51.627079 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305db60-aaed-48bd-b8f7-f4c6355b9215 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:51.627633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305db60-aaed-48bd-b8f7-f4c6355b9215 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:51.627633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305db60-aaed-48bd-b8f7-f4c6355b9215 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:51.632173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:51.637551 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:51.638083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:51.638215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:51.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:51.658734 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:51.666394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 22:22:51.688566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305db60-aaed-48bd-b8f7-f4c6355b9215 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:51.700817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305db60-aaed-48bd-b8f7-f4c6355b9215 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:51.704917 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd834971bff2f4ef9b259002b3b3122c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:51.705548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:51.705829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:51.706738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:51.714339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:51.716284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819274-9089-49a3-b987-da3018f9680d admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:51.724983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 22:22:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 22:22:51.730590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:51.739572 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bf4d8-ff8c-48ea-a6b1-2301b0cbb3db None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:51.744216 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd834971bff2f4ef9b259002b3b3122c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90890bf-0f99-4432-af2b-9798b3a438d3 admin admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:51.769990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jun 29 22:22:51 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:53.844039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3887-23c2-4333-b970-cc5e24ead078 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:53.844579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3887-23c2-4333-b970-cc5e24ead078 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:53.844674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d3887-23c2-4333-b970-cc5e24ead078 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:53.846002 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:53.851209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:53.851617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:53.851772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:53.868532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7ffd-fb9d-4e28-85e3-d90792e9573c None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:53.868682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:53.868916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7ffd-fb9d-4e28-85e3-d90792e9573c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:53.869088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7ffd-fb9d-4e28-85e3-d90792e9573c None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:53.869852 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:53.870584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:22:53.875077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:53.875365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:53.875644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:53.916512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG passlib.handlers.bcrypt [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80046) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 22:22:53.916926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG passlib.handlers.bcrypt [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80046) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 22:22:53.953754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:22:53.963032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:53.964666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:53.977001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.003757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.074766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:22:54.086722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b45803-b63c-4d91-90b9-7ca5d1535c44 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.097107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.122029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.122828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.123119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.123402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.135945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:22:54.147303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:22:54.148251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:22:54.149095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:22:54.154563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.212421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c8b1c-415e-487a-9658-6e416b77cfcc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.215084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.244042 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.253144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.254039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.262015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.262015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.262375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86567d33-6a6d-41e9-8c13-63d39363a8b9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.297117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.297408 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.297680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.298606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:22:54.298911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.300860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.313558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:54.319045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.325948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.327487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.428145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59deecc7-479b-45ed-80ae-d101086772c3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.433686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:22:54.439637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.445350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.466580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.467456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.467740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.468021 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.469259 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.470828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.476956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:54.477778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.493140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.551915 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8e7d9-d8c1-4fff-aa7b-9b0d47179379 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.582276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c41bf0-fbb8-4d1a-b2df-f0fb7c3e9a4e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.588015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.588840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.589126 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.589402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.610201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.611673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.618551 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.619912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.620342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.620803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.622129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.623713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.625510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:54.631522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:22:54.634137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:22:54.635103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:22:54.636213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:22:54.636213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:22:54.636213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:22:54.636213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:22:54.636213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:22:54.641175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:54.703856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.720092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:54.740460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcab15-2056-454c-beb1-5b61cea6ae8b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.754873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda34c-37a4-4eae-bed7-ff5784a2fd74 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:54.785928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.786596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.786880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.787163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.787982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.domain.id=default, user.id=881f643b49de4de49b74d4154b0f6d09) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:22:54.788343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.789783 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e13993-608b-439f-9a42-07441c4cae44 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.791197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:54.791858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:54.792141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:54.792466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:54.793196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:22:54.793503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:54.794952 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e70482-6f4c-4ac0-8465-e56209c8880d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:54.796758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/role_assignments?user.id=881f643b49de4de49b74d4154b0f6d09&scope.domain.id=default&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 233 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:54.815397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:56.993422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fcb8-5d4b-46f8-945a-1280ced47ab5 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:56.994488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fcb8-5d4b-46f8-945a-1280ced47ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:56.994985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fcb8-5d4b-46f8-945a-1280ced47ab5 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:56.996895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:57.002161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43258-1365-4f52-b02a-0cb7372df1c0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.003492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43258-1365-4f52-b02a-0cb7372df1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.003956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee43258-1365-4f52-b02a-0cb7372df1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.026886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3ee43258-1365-4f52-b02a-0cb7372df1c0 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:57.028371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3ee43258-1365-4f52-b02a-0cb7372df1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:57.110082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:22:57.155880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fcb8-5d4b-46f8-945a-1280ced47ab5 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:57.285646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fcb8-5d4b-46f8-945a-1280ced47ab5 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:57.318603 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1d66-b709-473f-8364-3058acdd48de None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.319252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1d66-b709-473f-8364-3058acdd48de None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.319719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f1d66-b709-473f-8364-3058acdd48de None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.321307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:57.326766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.327291 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.327768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:57.350880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:57.351922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.352430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.352917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.354804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:57.376593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:22:57.392033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:22:57.392899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:22:57.394173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:22:57.400098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:22:57.404660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:57.415991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:57.464127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:57.527785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:22:57.574050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:57.633051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f79cf-28ac-4304-b0d1-9f025bf6dce9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:57.730004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:57.730793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.731085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.731364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.732123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:22:57.732449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:57.733843 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:57.750516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:22:57.756755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:57.772239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31bc6c-84f2-4b64-bc81-9541ba5ab722 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:57.838655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:57.839502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:57.839785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:57.840056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:57.853445 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:57.855378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:22:57.875419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:22:57.876286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:22:57.877116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:22:57.877116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:22:57.877116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:22:57.877116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:22:57.877116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 14/28] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:22:57.883508 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:57.915455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:57.928834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:58.012171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c06e6e-02dc-48a0-9fd0-bec7b25c62bd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.038619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320f8d0-1d5e-41fc-a367-f1582b2a77c5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.087972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.090129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.090727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.091880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.093973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.096798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa482f9-e1d4-4515-a32b-3f55f6139b75 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:58.099299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:22:57 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:58.101165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ccb3-1243-49ea-885d-a9a054013837 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.101762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ccb3-1243-49ea-885d-a9a054013837 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.103045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ccb3-1243-49ea-885d-a9a054013837 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.104902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:58.105790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ccb3-1243-49ea-885d-a9a054013837 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:58.113498 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.114160 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.114665 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.115136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.116055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:22:58.116578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.118390 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591e54c-8c02-4ad3-b6d7-f5006b42d3d3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:58.149217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:22:58.150787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.151266 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.151731 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.180986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:58.182520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:58.270243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ccb3-1243-49ea-885d-a9a054013837 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.288298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:22:58.289053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:58.309821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:58.330065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.331311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.331596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.331870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.333080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.334527 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:58.336293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:22:58.336997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:58.347792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:58.403390 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f44bd7-cbe0-450e-8abc-67c4690259d6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.444518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.445860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.446381 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.446812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.447930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.449608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:58.526211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605088f2-7a32-4bc2-a4f3-3933a2c6d01d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.568017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.568798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.569068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.569336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.576426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.576426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957d489-55f1-4a7a-a66d-ddfe2ee45ba1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:58.688726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:22:58 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:22:58.689989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:58.838471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:58.852982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:22:58 2022] POST /identity/v3/roles => generated 219 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:22:58.906161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47069024-6c91-40af-b4aa-c2ea0ab4231a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:58.973405 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:58.974238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:58.974522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:58.974801 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] PATH_INFO: `/v3/domains/default/users/881f643b49de4de49b74d4154b0f6d09/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:58.977448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=881f643b49de4de49b74d4154b0f6d09, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:58.979024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517baec-bd4d-4104-9b61-9bf86773499c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:59.083586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 18/36] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jun 29 22:22:58 2022] PUT /identity/v3/domains/default/users/881f643b49de4de49b74d4154b0f6d09/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:22:59.261802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54695e9-b9d4-4af2-8795-68c521d0e35c None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.262276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54695e9-b9d4-4af2-8795-68c521d0e35c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.262276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54695e9-b9d4-4af2-8795-68c521d0e35c None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.263780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 19/37] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:59.269380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a43b-0c59-42d1-92e1-50176c3e72a8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.269668 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a43b-0c59-42d1-92e1-50176c3e72a8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.269945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93a43b-0c59-42d1-92e1-50176c3e72a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.293408 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5a93a43b-0c59-42d1-92e1-50176c3e72a8 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:59.294939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5a93a43b-0c59-42d1-92e1-50176c3e72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:59.400518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:22:59.434691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54695e9-b9d4-4af2-8795-68c521d0e35c None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:59.515838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:59.569786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54695e9-b9d4-4af2-8795-68c521d0e35c None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:22:59.611075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d546b-8517-4cd9-b6b7-5f4163be7abd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.611429 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d546b-8517-4cd9-b6b7-5f4163be7abd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.611636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d546b-8517-4cd9-b6b7-5f4163be7abd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.613359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:22:59.630206 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdd7d-ebd5-4dab-a0f4-141a53da4142 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.630527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdd7d-ebd5-4dab-a0f4-141a53da4142 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.630775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afdd7d-ebd5-4dab-a0f4-141a53da4142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.673155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d3afdd7d-ebd5-4dab-a0f4-141a53da4142 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:59.674808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d3afdd7d-ebd5-4dab-a0f4-141a53da4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:59.727898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:22:59.728605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.728893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.729172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.729932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:22:59.731511 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:22:59.765224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:22:59.776810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:22:59.778267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf9ab-e1ff-4398-a695-10ebb869d72d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.778560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf9ab-e1ff-4398-a695-10ebb869d72d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.778841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cf9ab-e1ff-4398-a695-10ebb869d72d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.780469 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 22/41] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:22:59.787016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:22:59.792338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:22:59.792338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:22:59.804215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:22:59.805468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:22:59.840366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 20/42] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:22:59 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:22:59.842703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:59.879221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:22:59.903764 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:22:59.978773 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a435fb-e2ea-46d0-80d0-f571797147b7 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:00.013849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:00.014542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:00.014827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:00.015105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:00.016190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:00.017462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f129f4-57dc-4cf9-a3e3-03ad9fd6d309 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:00.020751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:00.028264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8e23-4b86-49a8-8229-827b3a993ff3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:00.053271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:00.070437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:00.071592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:00.072100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:00.072626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:00.074216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:00.075902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:00.078377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 24/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:00.085670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:00.106280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 21/45] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:22:59 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:00.216575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fbad0-38c0-4c2a-b20f-e56cde6c582e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:00.254811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:00.255489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:00.255777 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:00.256063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:00.256840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:00.258334 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007f693-1a7c-4c0c-9b0d-a70da013a350 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:00.342320 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:23:00 2022] POST /identity/v3/projects => generated 312 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:01.499697 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767db5-2ab0-4b60-b29d-232ab5a6eee2 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:01.500177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767db5-2ab0-4b60-b29d-232ab5a6eee2 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:01.500177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f767db5-2ab0-4b60-b29d-232ab5a6eee2 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:01.501721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:01.507229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:01.507617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:01.507797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:01.524667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:01.525855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:01.664205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:01.696177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:01.718879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f767db5-2ab0-4b60-b29d-232ab5a6eee2 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:01.823939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f767db5-2ab0-4b60-b29d-232ab5a6eee2 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:01.856925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:01.857721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:01.858009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:01.858288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:01.869267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:01.876827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:01.878294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:01.879058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 23/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:01.885639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:01.988220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f11529-203f-42f7-b02b-36c810556986 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.030198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.030870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.031158 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.031434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.032177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:02.032511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.034402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.046592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 27/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:02.052914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:02.100105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:02.156077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fd1f7-f6f5-42a7-b1ef-5b3dce0d2a9a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.193356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.194240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.194541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.194892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.196138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.197848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.204442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 24/51] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:02 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:02.207055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:02.238877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:02.308649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad304a58-2b68-4328-a0cc-682bc53f7d81 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.342075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.342875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.343159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.343436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.344624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.346062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94a641-e2d2-4a96-98ea-74c6e9d36c63 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.348206 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 28/52] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:02.354103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:02.389634 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece3f6-10ac-4b9d-bf50-cfcf5348e059 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.389994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece3f6-10ac-4b9d-bf50-cfcf5348e059 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.390196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece3f6-10ac-4b9d-bf50-cfcf5348e059 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.391688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 29/53] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:02.396236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.396566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.396852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.413199 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:02.414375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:02.467687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0a7aa-e5bc-4670-b2dc-dd62cc933ab0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.479698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:02.483491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 30/54] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:02.503776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.504640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.504932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.505211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.506033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.domain.id=default, user.id=881f643b49de4de49b74d4154b0f6d09) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:02.506353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.507853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.508226 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:02.514567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 25/55] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 22:23:02 2022] GET /identity/v3/role_assignments?user.id=881f643b49de4de49b74d4154b0f6d09&scope.domain.id=default&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:02.550457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:02.625379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e16e-3079-46a9-a4a0-deed40b3f6a5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.662466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.663328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.664150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.664150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.665537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.666609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42879828-009c-4608-aa4e-ca407b6add7c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.668547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 31/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:02.673769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:02.778427 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc766a-d1c7-41a3-9610-11aa230def54 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:02.811766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:02.812458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:02.812749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:02.813040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:02.813758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:02.815199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b945be-53df-4ae7-a2bb-5578836c8021 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:02.876886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 26/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 22:23:02 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:04.895411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7e66-7138-4ce7-8c11-5a91213c4f41 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:04.895927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7e66-7138-4ce7-8c11-5a91213c4f41 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:04.896008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d7e66-7138-4ce7-8c11-5a91213c4f41 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:04.897395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 32/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:04.902460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:04.902850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:04.903033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:04.921190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:04.922727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:04.943551 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:04.989168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 27/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:05.013799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d7e66-7138-4ce7-8c11-5a91213c4f41 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:05.107073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:05.112241 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d7e66-7138-4ce7-8c11-5a91213c4f41 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:05.144570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:05.145348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:05.145677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:05.145898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:05.147051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:05.148510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745d1a4-bc11-468f-8ebe-7013f7307152 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:05.150108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 33/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:05.155609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:05.261754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe3f9-f48d-4e65-afc0-d0fd0629e344 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:05.293991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:05.294677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:05.294962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:05.295240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:05.295949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:05.297562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793841e-8451-495b-ae85-2ed97e0364f8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:05.406356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 28/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:05 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:23:08.779901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825d8b-f955-46d5-b4bd-b9c539d1ddc8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.779901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825d8b-f955-46d5-b4bd-b9c539d1ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.779901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc825d8b-f955-46d5-b4bd-b9c539d1ddc8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.779901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 34/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:08.785770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e0cc-0d0d-4446-8e62-a09528cf68e5 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.786587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e0cc-0d0d-4446-8e62-a09528cf68e5 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.787065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22e0cc-0d0d-4446-8e62-a09528cf68e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.813559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-3f22e0cc-0d0d-4446-8e62-a09528cf68e5 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:08.815165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-3f22e0cc-0d0d-4446-8e62-a09528cf68e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:08.823892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:08.877478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43090-aa24-4cd0-b6ca-c08292bcd079 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.878081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43090-aa24-4cd0-b6ca-c08292bcd079 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.878580 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43090-aa24-4cd0-b6ca-c08292bcd079 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.880434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 35/63] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:08.885036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.885566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.886036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.914137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:08.916301 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:08.937743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 29/64] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:08.946924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938a4d-26a8-4d70-9c41-923af2bae930 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.947439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938a4d-26a8-4d70-9c41-923af2bae930 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.947933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25938a4d-26a8-4d70-9c41-923af2bae930 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.949699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 30/65] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:08.965856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:08.966434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:08.966929 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:08.988926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:08.992381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:09.080987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 31/66] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:09.082051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.115805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:09.116554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.191954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.223649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f2259-76e0-474e-91c8-f651505e0919 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.278047 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.279150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.279591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.280007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.291389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:09.299172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:09.300208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:09.301184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:09.303023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 32/68] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:09.303982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.322181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.342411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ada7d0-c268-45b5-a882-03531b79b980 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.410933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824e4d3-ddbc-468c-8ab2-e07fcc36e2ca None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.426098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.426921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.427202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.427478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.443910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.449891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.450857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.451331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.451771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.457312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:09.463840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:09.466686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:09.467707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:09.468666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 37/69] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:09.469346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:09.479794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:09.480828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:09.481741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:09.483897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 33/70] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:09.484840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.599072 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d11a1-87ce-4acb-8f4a-5c227e26311e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.653994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.655723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.656296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.657889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.658832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:09.660020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:09.663035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:09.677010 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:09.678225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.692058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ce346-e1d5-45ec-a761-39cbbbb2c29b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.744797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.762336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.763061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.763387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.763665 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.764436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:09.764750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:09.766151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:09.784091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 38/72] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:09.785037 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.793962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b67e7-5d4f-4e80-81a8-7d91cbaf8f2e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.830613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.831619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.832087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.832527 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.833452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:09.833995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:09.835026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.836493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:09.845429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 35/73] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:09.846492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.927142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4a99b-0ea6-4f7d-86c2-4c752ac78f14 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.948518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c3b01-3ade-4158-bf1f-9f6151e5b2be None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:09.964366 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.965389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.965804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.966344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:09.967237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.984198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:09.985156 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:09.985973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5413114-9870-4cc3-9643-cb6570a71c7a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:09.986878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.987313 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.987725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.988699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 39/74] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:09.989236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:09.990345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be0a2-6b61-44cc-b303-ec98f584f714 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:09.990734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be0a2-6b61-44cc-b303-ec98f584f714 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:09.991115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7be0a2-6b61-44cc-b303-ec98f584f714 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:09.991386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:09.993547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 36/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:09.994507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:09.997148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 40/76] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:09.998026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7be0a2-6b61-44cc-b303-ec98f584f714 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.086816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.099291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ed40-ba39-4f3f-b55d-5acd062f16c7 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.112388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7be0a2-6b61-44cc-b303-ec98f584f714 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.137470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.138342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.138625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.138953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.140183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.141658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.143444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 37/77] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:10.144057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.159939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.160766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.161078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.161363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.198406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.246643 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00cf0-d9b6-4290-a799-5210aedd2bcd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.249794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.251473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb140-6ee5-4dc5-8dae-1171e500a904 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.285011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.285981 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.286255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.286672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.334903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.358157 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.358822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 41/78] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:10.360182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d9e1-6966-434e-a4a4-8ea5e132727c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.360589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d9e1-6966-434e-a4a4-8ea5e132727c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.360882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1d9e1-6966-434e-a4a4-8ea5e132727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.364918 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.379129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f9f1d9e1-6966-434e-a4a4-8ea5e132727c None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:10.380348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f9f1d9e1-6966-434e-a4a4-8ea5e132727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:10.420840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.450648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 42/79] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:10.461845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ed8a-5919-4e2c-93eb-646303ef9bda None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.462144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ed8a-5919-4e2c-93eb-646303ef9bda None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.462430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581ed8a-5919-4e2c-93eb-646303ef9bda None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.467678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 43/80] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:10.467678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ed8a-5919-4e2c-93eb-646303ef9bda None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.480102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 38/81] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:10.481277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.576014 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581ed8a-5919-4e2c-93eb-646303ef9bda None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.583908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.599023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2512300-f9bb-42d1-933e-65a08d154e14 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.612648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.614121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.614813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.615260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.635520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.636429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.636725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.637008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.638202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.639671 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df79c39-65de-40f2-80a4-2e5386e77cac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.641450 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 39/82] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:10.643202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.643495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.643779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.661210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:10.662418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:10.676773 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.702753 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.704843 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.731285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 40/83] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:10.731917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.821272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 44/84] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:10.822212 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.831283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.845143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbf0b1-03c7-43d8-8f81-c7b2666be96a None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.881245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.882042 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.882325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.882606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.883762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.885238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.887025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 41/85] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:10.887685 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.907135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:10.929871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965b415-abcf-41ee-b51f-10e19ae3c74e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:10.964351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:10.965175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:10.965459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:10.965730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:10.966918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:10.968357 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:10.970071 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 45/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:10.970855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:10.996589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344bf07-29ab-4a5e-b887-15c1e3468b60 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.031888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.032845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.033337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.033789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.034787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:11.035273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.036925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.052443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 42/87] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:11.052443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.052721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:11.077626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97b0f2-be46-4c36-867d-ac42d71a4ddf None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.115388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.116753 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.117388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.117897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.133539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:11.145027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:11.146180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:11.147110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:11.149315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 46/88] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:11.150205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.157634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:11.186573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf5f60-6b33-4b1e-9141-2a4541229c9b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.243552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.244354 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.244669 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.244948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.246249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.247711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.249739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 43/89] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:11.250821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.312003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88417732-d973-485b-b97d-a831d51fa622 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.347387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.348057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.348340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.348670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.349389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.351069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.360734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:11.380907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239c7f-8377-4a8c-b5b6-187f7493a9d0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.415570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.416227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.416541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.416823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.417652 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=881f643b49de4de49b74d4154b0f6d09) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:11.418068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.419506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.432651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/role_assignments?user.id=881f643b49de4de49b74d4154b0f6d09&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:11.432651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.452780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:11.473371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 47/91] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:11 2022] POST /identity/v3/users => generated 289 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:11.480018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.630797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33da2-9745-4774-9cd5-880975ef0285 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.682455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.683517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.683944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.684813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.685998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:11.686471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.687522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36d40e-46b7-4dbc-856b-2f77fd111fa8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.688204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.711850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 45/92] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:11.719108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.767140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.767851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.768133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.768434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.769313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:11.769627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.771064 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.791003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:11.839150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:11.863717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fced312-a1f0-47b6-9131-1fceaf67539e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:11.900148 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:11.901014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:11.901528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:11.902039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:11.903768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:11.905274 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:11.906976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:11.913234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:11.984780 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:12.036728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9e6b9-c333-4486-8542-1893e3310e19 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:12.080951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:12.081613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:12.081898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:12.082178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:12.167599 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:12.169059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:12.228067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:12.282296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 49/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:12.288361 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:12.391787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf467b-00ef-481d-b3d8-0c917b0b4b09 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:12.430430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:12.431264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:12.431558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:12.431838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] PATH_INFO: `/v3/projects/5e957772ba334c2bb777abaaac17e5f5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:12.433078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] RBAC: Authorizing `identity:get_project(project_id=5e957772ba334c2bb777abaaac17e5f5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:12.434534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f7053-6cbc-4db5-a605-d10b38f88a19 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:12.436236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:12 2022] GET /identity/v3/projects/5e957772ba334c2bb777abaaac17e5f5 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:12.442749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:12.553458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e7144-2f16-4041-9915-4a88f3f75e47 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:12.593024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:12.593685 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:12.593973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:12.594254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:12.595089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=5e957772ba334c2bb777abaaac17e5f5, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:12.595403 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:12.596940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f465-0e62-4c44-9f69-c8bfc1c3231a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:12.602787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:12 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=5e957772ba334c2bb777abaaac17e5f5&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:14.076005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0237-b859-4f31-96af-5a2d2b597fcc None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:14.076565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0237-b859-4f31-96af-5a2d2b597fcc None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:14.076642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd0237-b859-4f31-96af-5a2d2b597fcc None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:14.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:14.084202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:14.084620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:14.084797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:14.104493 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:14.105689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:14.124568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:14.187728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:14.228903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0237-b859-4f31-96af-5a2d2b597fcc None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:14.246616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:14.357024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd0237-b859-4f31-96af-5a2d2b597fcc None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:14.401814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:14.402654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:14.402942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:14.403219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:14.417747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:14.426597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:14.433467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:14.434244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 49/100] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:14.435670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:14.573439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4232e-7b87-47fe-bd1b-d2c6f7c1e2fd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:14.626382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:14.627538 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:14.627827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:14.628107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:14.628895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:14.629204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:14.630703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:14.638947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 52/101] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:14.644631 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:14.740573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:14.785104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cc641-6b56-4e58-98e8-367a3c75a15f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:14.824360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:14.825275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:14.825558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:14.825832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:14.827031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:14.828521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:14.830464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 50/102] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:14 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:14.835644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:14.862048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:15.017147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fba65-ad7d-4a5d-a55b-5afefcfc3a19 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:15.059380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:15.060299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.060667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.060951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.062413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:15.063857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd159f-3255-4dc0-9d1f-ba6a165729cb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:15.070088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 53/103] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:14 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:15.071284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:15.196427 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff99660-3b73-4ece-b814-060a4421534e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:15.227091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:15.227984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.228267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.228584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/d6a901d47b174c20bc27a77db56745a5/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.230839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, user_id=d6a901d47b174c20bc27a77db56745a5, role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:15.232296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df468e5-e5c1-4481-8799-779c46cc80f5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:15.316079 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff684c-b692-4113-9d2b-ffdcfa0136b4 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.316579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff684c-b692-4113-9d2b-ffdcfa0136b4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.316579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff684c-b692-4113-9d2b-ffdcfa0136b4 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.317945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 54/104] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:15.323359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee41e7-07ef-4d1f-ae07-f56380993cd1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.323655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee41e7-07ef-4d1f-ae07-f56380993cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.323999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee41e7-07ef-4d1f-ae07-f56380993cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.331174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:15.336037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 51/105] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:15 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/d6a901d47b174c20bc27a77db56745a5/roles/1e933b37fb62445f9e9755ca954a80cd => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:15.347182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-cdee41e7-07ef-4d1f-ae07-f56380993cd1 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:15.348881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-cdee41e7-07ef-4d1f-ae07-f56380993cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:15.435664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 55/106] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:15.463209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5bfb-3175-40bd-9f08-25a420a48918 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.463573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5bfb-3175-40bd-9f08-25a420a48918 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.463866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5bfb-3175-40bd-9f08-25a420a48918 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.465698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 52/107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:15.472297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49992-54ae-442d-81fc-9aa5a022f909 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.472633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49992-54ae-442d-81fc-9aa5a022f909 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.472922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe49992-54ae-442d-81fc-9aa5a022f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.479065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5bfb-3175-40bd-9f08-25a420a48918 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:15.509147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2fe49992-54ae-442d-81fc-9aa5a022f909 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:15.511670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2fe49992-54ae-442d-81fc-9aa5a022f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:15.514176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:15.650559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 56/108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:15.665923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5bfb-3175-40bd-9f08-25a420a48918 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:15.702426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:15.703219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.703501 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.703779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.712896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156879e-65fc-4e80-96c2-333d5cea5384 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.713192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156879e-65fc-4e80-96c2-333d5cea5384 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.713479 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156879e-65fc-4e80-96c2-333d5cea5384 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.714874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 57/109] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:15.722102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.722385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.722673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.724727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:15.736164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:15.737120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:15.737917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:15.746302 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 53/110] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:15.750667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:15.757359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:15.758547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:15.848824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:15.865113 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 58/111] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 29 22:23:15.865986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:15.894169 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9976dc-e14f-4793-8148-628af78884ef None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:15.934808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:15.935582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.935894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.936180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.947971 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-2e0a9da3-15e7-4a95-b734-33961d814773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:15.956239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:15.958657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 54/112] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:15.961353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a536a-fa28-4984-a8d2-58a11f2903e8 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:15.963129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a536a-fa28-4984-a8d2-58a11f2903e8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:15.963129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a536a-fa28-4984-a8d2-58a11f2903e8 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:15.963129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 55/113] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:15.963129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a536a-fa28-4984-a8d2-58a11f2903e8 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.029745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.067000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80727-48cc-4a72-ad8f-4d56d3af7c6b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.071315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a536a-fa28-4984-a8d2-58a11f2903e8 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.094537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.103472 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.104154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.104466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.104759 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.105519 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:16.105835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.107227 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6252a4-cf34-4708-94db-ffdf8f3dd9eb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.109347 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.110230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.110525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.110809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.112687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.114393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.117806 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 56/114] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.127506 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 59/115] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.127628 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.127711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5b20-45ce-4614-9379-95a9ae470a2f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.127711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5b20-45ce-4614-9379-95a9ae470a2f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.127711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b5b20-45ce-4614-9379-95a9ae470a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.143118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7f1b5b20-45ce-4614-9379-95a9ae470a2f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:16.144677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7f1b5b20-45ce-4614-9379-95a9ae470a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 60/116] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9f06-1161-4391-be8a-856ddca5a02f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9f06-1161-4391-be8a-856ddca5a02f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a9f06-1161-4391-be8a-856ddca5a02f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 61/117] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:16.225523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a9f06-1161-4391-be8a-856ddca5a02f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.233321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3e7f7-13f9-4c3d-86c3-7409b9de0510 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.275080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.275774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.276058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.276334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.277121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:16.277429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.278797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.289342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.289985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.310950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.353234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a9f06-1161-4391-be8a-856ddca5a02f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.354401 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.391186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.392237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.392784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.393278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.394207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.395865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.415038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d2fd6-351e-4f52-a27f-47eea56cdd00 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.451801 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.452747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.453035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.453311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.454509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.456008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90edb131-a668-4730-9e20-a66e58a11a8f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.457673 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 58/119] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.462438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.462438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.462438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.478644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:16.479765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:16.512280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 62/120] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:23:16 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:16.513483 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.577204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 59/121] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:16.581067 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.667246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.699782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f070960-0b68-4291-9fb0-eaa7eac51512 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.714385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.736074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d70a-e3e1-4fa3-ba5e-59d295e40c62 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.750120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.751081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.751837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.752124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.774708 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:16.781811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:16.782688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:16.784523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 63/122] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:16.790145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.790231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.790231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.790231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.790231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.790482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.792004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.793913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 60/123] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.794908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.919395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438f64-eebe-4d50-aa71-2b774d1c9577 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.930246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f219-f774-46c9-972d-8e96e84acfe8 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:16.951506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:16.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.959090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.959667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.960171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:16.961637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:16.963356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:16.970153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:16.970153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:16.981288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:16.982090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:16.982377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:16.982655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.003455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:17.016560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:17.018029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:17.018804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:17.030467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 61/125] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:17.032469 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.048628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:17.112841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e969d-4ad8-46d6-b9af-2b7cd82a28d8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.156632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe0c55-c2a4-4eb2-8c78-f61ca7d56c3f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.186376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.188070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.188579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.189093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.196427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:17.196989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.198442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.204880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.205831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.206117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.206400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.211222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.212730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.217178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 65/126] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:17.218228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 62/127] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:17.219002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.221056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.277930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:17.349267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b412dd-c18f-43cb-9337-39770bad6e3c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.358395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c145a-a745-4ca1-937a-0ceddc72f3ab None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.360049 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:17.393984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.394554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.395063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.395491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.395755 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.396130 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.396243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.396614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/881f643b49de4de49b74d4154b0f6d09/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.397289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:17.397856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.399051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, user_id=881f643b49de4de49b74d4154b0f6d09, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.399672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.400705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.410354 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:17.411592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.506585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 66/129] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:17 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/881f643b49de4de49b74d4154b0f6d09/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:17.507211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.561727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d2b537-f36b-4036-8417-b29f9965e51b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.579179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:17.665788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.666694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.666983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.667260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.673270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.674851 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.676874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:17.677211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5829a-4d11-45f5-b8bf-b605caed7970 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.677443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.721890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.722792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.723070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.723345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/d6a901d47b174c20bc27a77db56745a5/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.730059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, user_id=d6a901d47b174c20bc27a77db56745a5, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.731537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.829902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963c63-05c5-40e3-b410-e94eca2d5c02 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:17.835182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 67/131] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:17 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/d6a901d47b174c20bc27a77db56745a5/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:17.836048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.875394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:17.876973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.877738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.878238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] PATH_INFO: `/v3/users/61e67fc43fa94d8b832eea2f15b03ccd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.895621 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] RBAC: Authorizing `identity:get_user(user_id=61e67fc43fa94d8b832eea2f15b03ccd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:17.896904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:17.898447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b13c6-33fc-4e81-af9c-c7cf88cf9441 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:17.900587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 65/132] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/users/61e67fc43fa94d8b832eea2f15b03ccd => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:17.902177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0103-82fd-4ba8-a271-38aac7844d9d None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:17.902672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0103-82fd-4ba8-a271-38aac7844d9d None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:17.903161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0103-82fd-4ba8-a271-38aac7844d9d None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:17.904610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 66/133] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:17.910346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0103-82fd-4ba8-a271-38aac7844d9d None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:17.974277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.014512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873d3b5-ba15-41c4-8e31-cded9e409c77 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.059947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0103-82fd-4ba8-a271-38aac7844d9d None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.060940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.061972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.062422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.062828 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] PATH_INFO: `/v3/projects/5e957772ba334c2bb777abaaac17e5f5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.064388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] RBAC: Authorizing `identity:get_project(project_id=5e957772ba334c2bb777abaaac17e5f5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:18.066032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9131f9-d300-4e8b-9a1d-e1961de5a34d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:18.067926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 68/134] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/projects/5e957772ba334c2bb777abaaac17e5f5 => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:18.069285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.069719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.070141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.088769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:18.090177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:18.122909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.123805 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.124237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.124683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.208858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 69/135] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:18.210107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.264636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:18.266341 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:18.274658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.328423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.374698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bbfe52-c424-47c8-9068-7e565874e37f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.428979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.429982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.430270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.430548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] PATH_INFO: `/v3/projects/5e957772ba334c2bb777abaaac17e5f5/users/d6a901d47b174c20bc27a77db56745a5/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.432709 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] RBAC: Authorizing `identity:create_grant(project_id=5e957772ba334c2bb777abaaac17e5f5, user_id=d6a901d47b174c20bc27a77db56745a5, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:18.434365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:18.450590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 67/136] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:18.451665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.511956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 70/137] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:18 2022] PUT /identity/v3/projects/5e957772ba334c2bb777abaaac17e5f5/users/d6a901d47b174c20bc27a77db56745a5/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:18.514557 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.561284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a56dd-9a5c-4de8-86ac-2495504384c1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.597903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.600572 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.601613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.602076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.602497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.615869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:18.624932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:18.626027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:18.627027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:18.629103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 68/138] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:18.635492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.763353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e3cd-bf53-4427-afc9-d1bee09a156a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.780760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.798846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00715a9b-35ea-4b3b-9701-1b568f28241f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:18.801261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.801945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.802229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.802506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.803261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:18.803568 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:18.805007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:18.813950 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 69/139] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:18.819303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.872912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:18.873784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:18.874071 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:18.874349 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:18.877207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:18.878633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:18.880376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 71/140] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:18 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:18.886411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:18.920792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:18.998314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1faa0-f458-4fec-af26-52b299c5aa65 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.070356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.071611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.072117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.072612 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.074055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.075878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:19.077776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 70/141] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:18 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:19.084554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:19.112041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8fc00-9b07-4153-8a49-ea82cf510ee4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.191969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.191969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.192203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.192838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.193959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=61e67fc43fa94d8b832eea2f15b03ccd) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:19.194501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.197058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb7782-8cdc-4b4b-aecd-578c4f6babe9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:19.211082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 72/142] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:18 2022] GET /identity/v3/role_assignments?user.id=61e67fc43fa94d8b832eea2f15b03ccd&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:19.236334 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6cc49-6216-4446-b1ba-3abfa5319506 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.236679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6cc49-6216-4446-b1ba-3abfa5319506 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.236923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6cc49-6216-4446-b1ba-3abfa5319506 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.238298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 73/143] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:19.244365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.248598 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.248598 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.263893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d426dc6-c0be-4616-9f15-d431401e923f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.270612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:19.271897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:19.290726 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:19.300792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:19.313123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.313794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.314618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.314901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.436930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 74/144] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:19.455789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.457400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:19.492796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:19.563843 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 71/145] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:19.573787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:19.628106 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:19.639163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563b8f1-84a3-408a-9db7-6eef339919ed None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.694842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.695576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.695859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.696136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.697327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.698918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:19.700841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 75/146] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:19.706738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:19.723275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:19.833322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830043b-7a3f-4eb7-83ce-93111149b0dd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.854466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda4e9d-e531-4cba-ba51-6357fc9363bb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:19.909116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.910000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.910286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.910563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.911802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.913293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:19.915305 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 72/147] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:19 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:19.919909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:19.920686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:19.920897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:19.921012 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:19.921329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:19.922047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:19.923650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edb51c-5f7d-4dda-8426-431dbc788fbb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:20.033445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:20.042828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2afef-c42b-4383-9616-f9554ff34078 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:20.083899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:20.084600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:20.084888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:20.085167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:20.086002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:20.086314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:20.087767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0880d-47e0-4da3-9874-ae0992950b76 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:20.094198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:19 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:20.132960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 76/149] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:19 2022] POST /identity/v3/users => generated 283 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:20.855444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2ed0-2f97-43d6-8b63-c2fef4ae848e None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:20.856500 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2ed0-2f97-43d6-8b63-c2fef4ae848e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:20.856990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d2ed0-2f97-43d6-8b63-c2fef4ae848e None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:20.858846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 74/150] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:20.864562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdc85-de06-4346-896f-8cb2e3e782c3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:20.865444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdc85-de06-4346-896f-8cb2e3e782c3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:20.865914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fdc85-de06-4346-896f-8cb2e3e782c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:20.889588 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-425fdc85-de06-4346-896f-8cb2e3e782c3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:20.891109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-425fdc85-de06-4346-896f-8cb2e3e782c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:20.965810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:20.978191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 77/151] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:21.021439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2ed0-2f97-43d6-8b63-c2fef4ae848e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.133409 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d2ed0-2f97-43d6-8b63-c2fef4ae848e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.174475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.175273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.175551 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.175881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.198403 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:21.202809 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04fda-1998-4a34-a30b-de8a4bfe385c None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04fda-1998-4a34-a30b-de8a4bfe385c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04fda-1998-4a34-a30b-de8a4bfe385c None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 78/152] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.214246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:21.218862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:21.219712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:21.221089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:21.223497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:21.234800 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.236482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:21.237657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:21.252599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:21.330376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 79/154] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:21.360920 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.380449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee2e60-71b7-45db-a3d4-750e66592641 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.451844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.452576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.452862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.453449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.454039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:21.454414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:21.459092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c0daa-be00-494a-885f-a908849b3853 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:21.474613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae72e5-3cbb-46ce-bc78-6cf266bd7240 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.474873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 76/155] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:21.476226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895033-5637-4a46-b122-462ee88ea71e None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.476611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895033-5637-4a46-b122-462ee88ea71e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.476890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895033-5637-4a46-b122-462ee88ea71e None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.478289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 77/156] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:21.485332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895033-5637-4a46-b122-462ee88ea71e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.510636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:21.525646 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.526716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.527184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.527730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.544884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9afd4401-6364-4476-9c95-5b8d9c376972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:21.554134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:21.555215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:21.556181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:21.558118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 80/157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:21.559444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.559914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.560342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.576712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:21.586758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:21.590854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:21.602458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895033-5637-4a46-b122-462ee88ea71e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.642848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.643737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.644020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.644296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] PATH_INFO: `/v3/users/881f643b49de4de49b74d4154b0f6d09` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.645576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] RBAC: Authorizing `identity:get_user(user_id=881f643b49de4de49b74d4154b0f6d09)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:21.647180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:21.649020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 78/158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/users/881f643b49de4de49b74d4154b0f6d09 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:21.649810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.695345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 81/159] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:21.696498 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.770218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb2074-a8a0-4cdf-9fea-3dce1424f373 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.806888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.807568 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.807858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.808139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.808854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2928e-f99e-4a02-8652-c665cd36e060 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.809025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:21.809224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:21.810617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:21.822212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 79/160] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:21.823072 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:21.829144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:21.836844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:21.848633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.849559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.849978 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.850432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.927074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:21.929213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:21.934043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531904a-dce0-476f-b0a2-b9fbdec2565f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:21.969539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:21.970379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:21.970666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:21.970945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:21.982435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:21.990845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:21.992082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 80/161] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:21.993207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.041133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 82/162] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:22.042177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.066183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.072765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.104275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd23d8-1797-4a55-828b-984b67a4d221 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.140154 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186944f-a094-4949-be51-947390d47a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.141361 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186944f-a094-4949-be51-947390d47a51 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.141361 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186944f-a094-4949-be51-947390d47a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.141594 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186944f-a094-4949-be51-947390d47a51 None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.142840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186944f-a094-4949-be51-947390d47a51 None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.144375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186944f-a094-4949-be51-947390d47a51 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.146012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 81/163] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:21 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.146794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186944f-a094-4949-be51-947390d47a51 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.154430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b50e3b-6405-42a9-971f-da763a83e2bd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.194543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.195500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.195921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.196353 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.197281 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:22.197996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.199567 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.208988 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 83/164] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.210168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.286562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186944f-a094-4949-be51-947390d47a51 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.294796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.320700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca680c1-7c9c-471a-b2b2-07981fbd1519 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.368322 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.369256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.369680 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.370092 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.383795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.384711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.384995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.385271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.386485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.387944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.390028 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 82/165] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.392450 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.395058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.489649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.491116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.629404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.649125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44aa7d-1033-43ef-9841-d4b20acbe8f1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.668623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:22.669501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.721913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.722795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.723083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.723356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] PATH_INFO: `/v3/users/d6a901d47b174c20bc27a77db56745a5` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.725801 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] RBAC: Authorizing `identity:get_user(user_id=d6a901d47b174c20bc27a77db56745a5)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.727269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b3f05-2682-4d5d-81bb-02604c5abaf9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.729123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 83/167] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/users/d6a901d47b174c20bc27a77db56745a5 => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.730131 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6b56-32d4-4af4-8bcc-dd12774de2fc None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.730418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6b56-32d4-4af4-8bcc-dd12774de2fc None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.730698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d6b56-32d4-4af4-8bcc-dd12774de2fc None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.732014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 84/168] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:22.734880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d6b56-32d4-4af4-8bcc-dd12774de2fc None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.866031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:22.882660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9bd90-1702-4bf1-8ec5-b7c857890085 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.918110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d6b56-32d4-4af4-8bcc-dd12774de2fc None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:22.961115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.961837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.962041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.962324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.963167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=881f643b49de4de49b74d4154b0f6d09) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:22.963477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.964570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:22.964995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a445157-e4cb-46e6-8401-e59e95d4ab02 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.965318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.965596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.965869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:22.967145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:22.968617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:22.970768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.971548 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:22.975830 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 85/170] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/role_assignments?user.id=881f643b49de4de49b74d4154b0f6d09&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:22.977222 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:22.977621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:22.977905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.013530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:23.014748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:23.105547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.134750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397e050-d88d-42cc-b77a-89ddadbc08e3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.177719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 86/171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:23.178590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.196640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.197311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.197831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.198293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.210454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.305038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:23.306665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:23.419247 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2fb1f-ffd4-44e2-aa3f-884c3806b88a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.438296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 86/172] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:23.439312 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.484530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.496038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.497171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.497634 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.498096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.499105 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:23.499637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:23.501452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:23.508245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 87/173] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 608 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:23.509331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.554398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc28480-489a-4fab-9a50-845a4624b7ee None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.576932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.597280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.598591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.598892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.599146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.620449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:23.632250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:23.633265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:23.634066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 87/174] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:23.641201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.707857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965f939-19c4-41ae-a0d5-c3def18d46f2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.784396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.785684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.786422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.788120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] PATH_INFO: `/v3/projects/5e957772ba334c2bb777abaaac17e5f5` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.789942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] RBAC: Authorizing `identity:get_project(project_id=5e957772ba334c2bb777abaaac17e5f5)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:23.792396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:23.794662 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/projects/5e957772ba334c2bb777abaaac17e5f5 => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:23.800917 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.814851 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.819533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed9c41-e79c-4a4a-a338-492553267e1a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.879623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.880306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.880664 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.880943 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.881750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:23.882066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:23.883449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:23.897284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:23.904133 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:23.955601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a251b-0615-4b14-a370-7999a6d9bf67 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:23.964345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:23.995678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:23.996739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:23.997225 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:23.997847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:23.998891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=5e957772ba334c2bb777abaaac17e5f5, user.id=d6a901d47b174c20bc27a77db56745a5) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:23.999430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.001120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.008743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/role_assignments?user.id=d6a901d47b174c20bc27a77db56745a5&scope.project.id=5e957772ba334c2bb777abaaac17e5f5&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:24.046709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17784-41cf-4a5c-8e80-af353344ec9c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.087452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.088332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.088640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] PATH_INFO: `/v3/users/61e67fc43fa94d8b832eea2f15b03ccd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.090194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] RBAC: Authorizing `identity:get_user(user_id=61e67fc43fa94d8b832eea2f15b03ccd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.091678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f14682-dff3-47bf-a7bc-ecedd2829af7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.093600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:23 2022] GET /identity/v3/users/61e67fc43fa94d8b832eea2f15b03ccd => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:24.099189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:24.121514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa80ea-79df-41d0-ad15-a8e212aff431 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.121832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa80ea-79df-41d0-ad15-a8e212aff431 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.122122 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa80ea-79df-41d0-ad15-a8e212aff431 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.123738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 90/179] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:24.134334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.134686 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.134968 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.160994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:24.160994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:24.196439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:24.286594 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 91/180] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:24.303987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b244b2-8962-4b6f-92fb-f3dc405e21e5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.317185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:24.386928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.387799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.388073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.388345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.391816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.393525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.399855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 90/181] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:24 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:24.408500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:24.452255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:24.466028 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdcace-4117-4a7f-8773-6ba791758ab4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.504952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.505831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.506111 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.506383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.517986 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:24.528710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:24.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:24.530386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 92/182] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:24.536236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:24.544490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a070-d9c6-4d29-8400-16f0ebc2f8f5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.560516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:24.601760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.602676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.602958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.603231 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/61e67fc43fa94d8b832eea2f15b03ccd/roles/ea6e90da441843fca19f1bb7502ab8fa` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.609790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, user_id=61e67fc43fa94d8b832eea2f15b03ccd, role_id=ea6e90da441843fca19f1bb7502ab8fa)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.611864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.664318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927314bb-8bbc-400d-a604-5d081caf8e75 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.697457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 91/183] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:24 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/users/61e67fc43fa94d8b832eea2f15b03ccd/roles/ea6e90da441843fca19f1bb7502ab8fa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:24.707507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.719747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f223be-08d3-4123-811a-d5703a56cb38 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.723580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 93/184] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:24.733578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:24.893470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebed9e-5373-43b3-894f-37aee454eca7 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.894071 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebed9e-5373-43b3-894f-37aee454eca7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.894532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:24.895038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ebed9e-5373-43b3-894f-37aee454eca7 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.897131 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 94/185] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:24.900729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4211b-de51-4062-afcd-7c02ecf7e08d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:24.903994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b307-5791-4802-bb0f-49b2d8f78aa3 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.908542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b307-5791-4802-bb0f-49b2d8f78aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.908542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132b307-5791-4802-bb0f-49b2d8f78aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.930060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-c132b307-5791-4802-bb0f-49b2d8f78aa3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:24.931578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-c132b307-5791-4802-bb0f-49b2d8f78aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:24.946766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:24.948165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:24.948524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:24.948814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:24.966530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:24.968013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:24.970730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 92/186] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:24 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:24.975586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.024270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 95/187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:25.030781 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1449-3bf7-4368-81dd-fa9ca8d1f470 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.031068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1449-3bf7-4368-81dd-fa9ca8d1f470 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.031351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c1449-3bf7-4368-81dd-fa9ca8d1f470 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.033735 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 96/188] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:25.040424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.040424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.040424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.062030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:25.063218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:25.067221 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.106404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cadb75-3b79-4dac-924f-cbad4d0d1b73 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.143169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.143929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.144151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.144460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.149151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 97/189] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:25.150292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.171100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.229307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.230995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.280461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b67b8a-c905-4220-8d75-bd00c19cd859 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.321253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.321533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.321804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.339661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.342940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:25.350473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 93/190] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:25.351153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:25.352016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:25.352860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:25.354221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.357055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:25.357768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.425075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.479499 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb877c29-56a5-49a4-b7e7-ea282349bfdd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.488539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7179-278f-43f3-ad03-2ee3ee89d809 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.525170 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.525605 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.526069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.526352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.526460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.526715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.526912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.527960 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.528177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.529451 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.529660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.531363 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 99/192] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:25.531476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 94/193] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:25.531963 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.536803 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.612243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.645857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa30b5e-36ab-4451-8984-e81c3142d8c8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.649679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b935b-f75e-4f08-bf91-54614bc2fc99 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.674672 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.691957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.691957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.691957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.691957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.692348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.692348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.692491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.692491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.692491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.692693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.695304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:25.695304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.695304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.703663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 100/194] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:25.704628 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.802189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5476b3-e8d3-4be3-ac51-46d0c4c31616 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:25.830762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:25.836782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:25.837614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:25.838030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:25.838436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:25.839447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=a31561f0ac274c9385fe77be363108c4) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:25.839895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:25.841749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:25.855057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 101/195] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/role_assignments?user.id=a31561f0ac274c9385fe77be363108c4&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:25.856077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:25.872473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 95/196] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:25 2022] POST /identity/v3/users => generated 297 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:26.017168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e22a2-12d6-4fb5-86a8-02238f6a99bb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:26.060452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:26.061328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:26.061609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:26.061884 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:26.063106 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:26.065167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:26.067185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 102/197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:25 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:26.072764 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:26.185608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de57682-7218-4be6-919c-b4d5d64d4f4c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:26.227414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:26.228073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:26.228363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:26.228680 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:26.282961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:26.307297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:26.308884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:26.413578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 96/198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:26.418785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:26.490740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:26.542124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77149c33-f9d0-4d37-b165-5562fc0dd75a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:26.597203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:26.598102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:26.598385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:26.598661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:26.600009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:26.601535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8543f9e-b350-4eba-bc72-e1589a904d4c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:26.603306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 103/199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:26 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:26.609303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:26.746323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:26.822773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5771d5-6b2e-43a3-9d33-620b0842dcbf None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:26.928243 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:26.928932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:26.929219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:26.929495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:26.930338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=a31561f0ac274c9385fe77be363108c4) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:26.930649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:26.932101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81c110-1cf3-4fe8-924d-427a08e94a70 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:26.940543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 97/200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:26 2022] GET /identity/v3/role_assignments?user.id=a31561f0ac274c9385fe77be363108c4&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:27.053966 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397a00-0b80-4103-a93e-64eba03f183b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.054577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397a00-0b80-4103-a93e-64eba03f183b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.055067 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397a00-0b80-4103-a93e-64eba03f183b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.056663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 104/201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:27.061976 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.062535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.063012 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.081249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:27.083210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:27.173239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 98/202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:27.205619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397a00-0b80-4103-a93e-64eba03f183b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:27.313449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397a00-0b80-4103-a93e-64eba03f183b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:27.342204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:27.352614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:27.353427 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.353710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.353981 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.367964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:27.375892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:27.376888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:27.377668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:27.380483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 105/203] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:27.386556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:27.469580 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:27.501441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73988e37-fc73-4f0b-b41e-42b93eb7f168 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:27.543492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:27.544159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.544457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.544736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.545480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:27.545866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:27.547246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:27.561079 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 99/204] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:27.567064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:27.701581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914cc7-182a-453b-a0c2-1ca36cccc523 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:27.756258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:27.757337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.757444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.757709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] PATH_INFO: `/v3/users/61e67fc43fa94d8b832eea2f15b03ccd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.776492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] RBAC: Authorizing `identity:get_user(user_id=61e67fc43fa94d8b832eea2f15b03ccd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:27.776492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:27.776492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 106/205] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:27 2022] GET /identity/v3/users/61e67fc43fa94d8b832eea2f15b03ccd => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:27.776726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:27.930070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd446a3-65b5-43b1-9b37-2b276c9b0f78 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:27.977724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:27.978292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:27.978574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:27.978851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:27.987375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:28.070946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:28.072435 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ffb73-9ea7-4559-80e8-e0b0c794dc9e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:28.194240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 100/206] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:28.199379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:28.270829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:28.313105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a7b9-9056-473f-9a6f-f9a9460662c9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:28.348862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:28.349721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.350002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.350273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.351440 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:28.352925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ecb2-09f9-4f14-a1f8-6b70886afefb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:28.354984 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2fd46-4b48-419c-b350-cdae09de2023 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.355265 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2fd46-4b48-419c-b350-cdae09de2023 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.355535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2fd46-4b48-419c-b350-cdae09de2023 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.356929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 101/207] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:28.358338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:28 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:28.364524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2fd46-4b48-419c-b350-cdae09de2023 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:28.373853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.374136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.374409 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.401418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:28.402664 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:28.407103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:28.492173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2fd46-4b48-419c-b350-cdae09de2023 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:28.531174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:28.532664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.533151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.533623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.534835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d, user.id=61e67fc43fa94d8b832eea2f15b03ccd) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:28.535362 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:28.537048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:28.544065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 102/209] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:28 2022] GET /identity/v3/role_assignments?user.id=61e67fc43fa94d8b832eea2f15b03ccd&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:28.567400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:28.601378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:28.716919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:28.721611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901151-3089-4a6b-b932-9335f67174bb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:28.757192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:28.758007 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.758290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.758565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.771048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:28.779414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:28.780345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:28.781161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 103/211] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:28.787376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:28.848362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:28.893244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6495af2-6a77-43db-9d3f-5ccb266432df None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:28.929185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:28.929856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:28.930138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:28.930415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:28.931164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:28.931531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:28.932993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:28.941942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 109/212] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:28.947550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.051848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791435-c08b-4feb-9f0e-61f5fa6673c0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.087254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.088141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.088498 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.088775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.089990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.091437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b4c73-9ead-43c5-a781-2f8d96ae1864 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.093398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 104/213] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:28 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:29.098954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.203242 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3af822-ddba-44ae-b013-b6cf6b76381c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.221322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.234410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249df79-e5ee-4e27-beda-0884dc523385 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.234896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249df79-e5ee-4e27-beda-0884dc523385 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.234971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249df79-e5ee-4e27-beda-0884dc523385 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.238041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 105/214] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:29.244294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.245201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.245488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.245766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.246984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.247320 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058074-6e3e-4cff-998b-f3c50a4a37d6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.247798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058074-6e3e-4cff-998b-f3c50a4a37d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.248263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058074-6e3e-4cff-998b-f3c50a4a37d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.248482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.250298 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:29 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:29.257212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.268661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-73058074-6e3e-4cff-998b-f3c50a4a37d6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:29.270152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-73058074-6e3e-4cff-998b-f3c50a4a37d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:29.291658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.344055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 106/216] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:29.345832 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334d5f-0992-4342-9b6d-5f7fec08d51d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.346322 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334d5f-0992-4342-9b6d-5f7fec08d51d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.346789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334d5f-0992-4342-9b6d-5f7fec08d51d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.348334 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 107/217] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:29.353427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.353963 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.354432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.372105 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:29.373701 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:29.376914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8ba3-1c00-479d-bc61-58a7e4867bc0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.412383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.414038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.414319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.414593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/users/a31561f0ac274c9385fe77be363108c4/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.416615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, user_id=a31561f0ac274c9385fe77be363108c4, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.418486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.444005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 108/218] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:29.445188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.496428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 111/219] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:29 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/users/a31561f0ac274c9385fe77be363108c4/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:29.496428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.536382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.552829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171e8e2-f783-413a-97cf-8112bd3c35fb None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.574901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.592413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.593242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.593714 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.594182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.595788 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.597585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.599430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 109/220] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:29.605072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.640462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e9e08-0213-4466-8b42-9568a95dfcea None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.688132 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.689007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.689285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.689557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.701264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:29.709144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:29.710057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:29.710835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 112/221] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:29.716033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.747406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3aaf3d-89f1-4d7a-a9ad-645f7ac980a9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.789772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.790568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.790923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.791278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.791993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.793619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f275b-3d26-4761-80bf-c7e9aac7f426 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.829322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6575a62-f16d-437a-b154-6c228b6a48d0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:29.836321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.863540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:29.864139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.864444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.864727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.865589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:29.865895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:29.867662 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:29.871612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 110/222] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:29 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:29.872980 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774558-93b0-4f0b-8598-5177b6cd4516 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.873448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774558-93b0-4f0b-8598-5177b6cd4516 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.909292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f774558-93b0-4f0b-8598-5177b6cd4516 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.909292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 111/223] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:29.909292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:29.909292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:29.909292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:29.909676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 113/224] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:29.909676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:29.909811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:29.909811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:29.930179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:29.994889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 112/225] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:30.023692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.031319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6da94-c00a-4f96-9607-89392a548f12 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.069647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.070887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.071175 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.071452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] PATH_INFO: `/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.089310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] RBAC: Authorizing `identity:get_user(user_id=9d3ddf07b77d4c62a8228ea4a65cc9c0)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.090571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.096465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 114/226] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:29 2022] GET /identity/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:30.098714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.135424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.153164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d75678-3b0c-4b95-bde9-e655d0c25aa4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.202315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.203369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.203659 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.204468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.215743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.219335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:30.228136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:30.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:30.229872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 113/227] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:30.235473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.240083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cebe-7218-45c3-a6d0-b94f77e3bdaa None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.288604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.289305 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.289592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.289875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.370796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.372364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.372504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b8037-fbe4-4057-937b-6b932bc51024 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.410559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.411296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.411588 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.411862 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.412660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:30.412967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.414347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.423449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 114/228] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:30.429664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.440681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.517392 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.542586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f557de-c86b-4aab-8903-2070d64fe1f3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.591104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.591989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.592270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.593124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.595137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.596631 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.601695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 115/229] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:30.609354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.620955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 115/230] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:30.633466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.764045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2f9e7-7ee4-4dba-b6d9-3c015342ec47 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.781737 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d0829-cf4d-4502-b4ae-97630d38906f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:30.792539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.815165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.816027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.816307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.816605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.818005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.819463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.823963 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 116/231] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:30.828880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.832471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:30.843712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:30.844631 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:30.844914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:30.845185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:30.846913 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:30.848370 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:30.850114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:30.857437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:30.955362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c51ae-89ea-4ac1-8ed2-d863761ac9bd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:31.269142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:31.269142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:31.269142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:31.269142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:31.270024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=9d3ddf07b77d4c62a8228ea4a65cc9c0) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:31.270024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:31.270024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da91a25-2715-400b-929b-2d03a18eeadb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:31.270024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:30 2022] GET /identity/v3/role_assignments?user.id=9d3ddf07b77d4c62a8228ea4a65cc9c0&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:31.270286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bad65-9dc2-45d0-ab62-de08321aee60 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:31.270286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:31.270286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:31.270286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:31.270825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/users/a31561f0ac274c9385fe77be363108c4/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:31.270825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, user_id=a31561f0ac274c9385fe77be363108c4, role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:31.270825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc077-c465-4f9b-bd65-c708bb882168 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:31.345152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 117/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:30 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/users/a31561f0ac274c9385fe77be363108c4/roles/1e933b37fb62445f9e9755ca954a80cd => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:32.030578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2426c-1a61-410f-8e88-84e188189326 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.031315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2426c-1a61-410f-8e88-84e188189326 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.031315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2426c-1a61-410f-8e88-84e188189326 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.033345 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 118/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:32.038525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.038825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.039110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.064229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:32.065636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:32.122895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.137873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 118/236] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:32.187710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2426c-1a61-410f-8e88-84e188189326 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.274199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.318895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2426c-1a61-410f-8e88-84e188189326 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:32.353954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:32.354753 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.355039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.355321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.366545 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-36c42647-61d1-4b80-8e5b-1f5acda1ce94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:32.374574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:32.377248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:32.379174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 119/237] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:32.385102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.446331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941beb-457c-4d79-9177-b66a2f659fd7 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.446331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941beb-457c-4d79-9177-b66a2f659fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.446331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae941beb-457c-4d79-9177-b66a2f659fd7 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.446937 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 120/238] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:32.451811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.452268 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.452722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.470183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:32.471582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:32.564612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf397dc6-9bb0-4a72-8a9a-2c9fec8ac949 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:32.573981 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 121/239] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:32.599153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:32.600067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.600530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.600951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.601841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:32.602279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:32.603785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:32.613186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 119/240] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:32.617027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.619052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.670632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.686212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.722992 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be6762-5ff5-4b7f-a9a7-b45852c98db1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:32.742795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a65dd-945b-4d83-9c51-aaba527f1256 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:32.757785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:32.758866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.759304 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.759721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.761089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:32.762657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc5004-219d-416f-824d-4e7e49e92f1a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:32.766177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 120/241] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:32 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:32.769923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16d04-ff75-4e26-b5e1-f1f00c722f11 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.770189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16d04-ff75-4e26-b5e1-f1f00c722f11 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.770692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d16d04-ff75-4e26-b5e1-f1f00c722f11 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.772371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 121/242] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:32.773355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16d04-ff75-4e26-b5e1-f1f00c722f11 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.787350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:32.788521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.789120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.789602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.791066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:32.792890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6ee5a-35c6-4190-b2ef-3c709da4174a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:32.795101 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 122/243] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:32.796683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.797194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.798233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.816774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:32.818418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:32.878372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d16d04-ff75-4e26-b5e1-f1f00c722f11 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:32.900536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 123/244] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:32.901237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.903052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:32.916860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:32.916860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:32.916860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:32.916860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:32.972611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:32.997338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:32.998798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.031793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2eec2-dfaf-46a4-b8d9-6a0bf4452141 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.071245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.072163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.072618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.073037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.073917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.075523 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.102922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 122/245] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:33.108134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.126891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.175096 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 124/246] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:32 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:33.177213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.221578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b25a7-3db1-4388-b28c-1d2209a1bde3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.258167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.258989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.259270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.259542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.272580 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7b0616cb-135e-478a-a5fe-900bb66bd277 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:33.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:33.281628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:33.283018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 123/247] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:33.283726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a186f-9662-4c14-a46f-87762065aef7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.289288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a186f-9662-4c14-a46f-87762065aef7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.289288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a186f-9662-4c14-a46f-87762065aef7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.289288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 124/248] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:33.291279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.291558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.291832 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.310065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:33.311267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:33.337359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6face-97c0-4543-8007-4c28ed7e7f0c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.339322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.375798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.377756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.378162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.378311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.380269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.381762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.383667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 125/249] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:33.384263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.404428 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 125/250] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:33.404428 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.417363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.511840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d47544-250f-4a11-b819-ed707e53c711 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.536195 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157a0ec-4e4d-4e8a-8b71-bc5fb7455641 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.569719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.570283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.570569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.570846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.571598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:33.571912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.573595 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.582882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.583554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.583865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.584116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.584994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=a31561f0ac274c9385fe77be363108c4) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:33.585311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.586407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 126/251] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:33.586784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.587724 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.596754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 126/252] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/role_assignments?user.id=a31561f0ac274c9385fe77be363108c4&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:33.597675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.630266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.683387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.710722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65aece-7739-4606-b8ff-f271fbb8d067 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.717128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9c94-fa1f-4c01-8e57-9c800c4d9736 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.748833 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.749967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.750491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.751470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.758704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.759855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.760198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.760505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] PATH_INFO: `/v3/users/7ffc700ea1dc4d1e93b0fa414a638250` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.765389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:33.774349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:33.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:33.776069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:33.776714 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7ffc700ea1dc4d1e93b0fa414a638250)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.777750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.779249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 127/253] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:33.784814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 127/254] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/users/7ffc700ea1dc4d1e93b0fa414a638250 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:33.786177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.787795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.888502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.897871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b96baa-d9d7-46cc-b223-8b1d6c4af82a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.936023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.937190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.937722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.938762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:33.939729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:33.940333 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:33.941991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:33.951704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 128/255] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:33.956133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db015-8803-488f-a9cf-7f376da489a5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:33.957412 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:33.993121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:33.997667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:33.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:33.998604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:33.998874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.085172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.086654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa067c-34b5-4ec4-b8fb-f7be008cdd8a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.097985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437d7f-5cbe-447f-9782-f4068064aca1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.140151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.141064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.141887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.142165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] PATH_INFO: `/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.144147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3ddf07b77d4c62a8228ea4a65cc9c0)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.145634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3589c-8867-40dc-bf3f-74cbee570795 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.147700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 129/256] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:34.149008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbce5c8-5b22-4cfb-962c-6ccf940e71d9 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.149292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbce5c8-5b22-4cfb-962c-6ccf940e71d9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.149569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbce5c8-5b22-4cfb-962c-6ccf940e71d9 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.150945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 130/257] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:34.155611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbce5c8-5b22-4cfb-962c-6ccf940e71d9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.183031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:34.212900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 128/258] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:34.214558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.214850 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.215125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.236684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:34.237858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:34.262430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:34.282809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbce5c8-5b22-4cfb-962c-6ccf940e71d9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.305270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 129/259] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:34.312109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.339800 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.340617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.340903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.341178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.342974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.344504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.346813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:34.347565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.421148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcba5c3-bb11-4df0-8fe6-0ed2cd3beae5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.437758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:34.447388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba39a5-7ed7-4684-9039-fcd7fcecbd99 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.465496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.465496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.465496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.465496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.465869 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.465869 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.466453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 130/261] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:34.467403 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.482569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.483386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.483666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.483939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.494609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:34.499202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:34.503502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:34.504465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:34.505282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:34.505954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.580712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd915b-9474-4020-89c7-17a70b464cd3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.609637 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c7bc9-dcfd-44da-9d8b-842c34972df0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.616140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.617326 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.617715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.617996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/users/9d3ddf07b77d4c62a8228ea4a65cc9c0/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.620101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, user_id=9d3ddf07b77d4c62a8228ea4a65cc9c0, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.621689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.645158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.645805 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.646074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.646349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.647172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=7ffc700ea1dc4d1e93b0fa414a638250) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:34.647479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.648959 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.654391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 133/263] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/role_assignments?user.id=7ffc700ea1dc4d1e93b0fa414a638250&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:34.655152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:34.677045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:34.701727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 131/264] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:34 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/users/9d3ddf07b77d4c62a8228ea4a65cc9c0/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:34.782566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb7c4-8317-4a0f-83ba-e9f953b5d029 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:34.890847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:34.891490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:34.891769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:34.892039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:34.892823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:34.893129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:34.894593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:34.909317 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 134/265] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:34.915027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:35.013852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:35.026619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bcad-1fe1-41d6-996d-323eaff9674d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:35.067851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:35.068757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:35.069041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:35.073849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] PATH_INFO: `/v3/users/a31561f0ac274c9385fe77be363108c4` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:35.073849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] RBAC: Authorizing `identity:get_user(user_id=a31561f0ac274c9385fe77be363108c4)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:35.073849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:35.073849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 132/266] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:34 2022] GET /identity/v3/users/a31561f0ac274c9385fe77be363108c4 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:35.079685 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:35.179227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:35.226323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb4354-f529-46d1-bbe2-c124709f12f7 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:35.276902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:35.277557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:35.277835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:35.278106 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:35.358218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:35.359720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:35.436977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:35.461029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 135/267] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:35.466351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:35.603949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c26f7-1a29-4652-bbcc-54b8f7040f95 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:35.646571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:35.647432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:35.647711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:35.647985 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:35.649215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:35.650662 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadf226-38db-4ba3-8c8d-b986f5ad4f17 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:35.652683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 133/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:35 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:35.658819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:35.799725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b26c-e9c5-4684-b28d-2b47b3f8d6d0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:35.848098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:35.848787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:35.849068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:35.849342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:35.850167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=a31561f0ac274c9385fe77be363108c4) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:35.850478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:35.851914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01af5-4a09-4143-ae96-179c7c331032 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:35.861683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 136/269] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:35 2022] GET /identity/v3/role_assignments?user.id=a31561f0ac274c9385fe77be363108c4&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:36.184596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70553d-4224-482a-9526-c0f8d6777ba6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.184878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70553d-4224-482a-9526-c0f8d6777ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.185149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70553d-4224-482a-9526-c0f8d6777ba6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.186516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 134/270] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:36.193485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.193936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.194112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.217441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:36.218622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:36.222672 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f7a1-146e-4b84-a204-212084b2b36f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.223175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f7a1-146e-4b84-a204-212084b2b36f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.223644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95f7a1-146e-4b84-a204-212084b2b36f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.225518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 135/271] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:36.232020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.232299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.232602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.252300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:36.254120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:36.283431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:36.284737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:36.310058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 137/272] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:36.342325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.351128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 136/273] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:36.382864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.454108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9991ba-aada-4f30-82db-c2e8eb0e5c58 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:36.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:36.495632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.496079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.496949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.498611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:36.500808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:36.507589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 138/274] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:36.508669 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.514838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0af3e7-4ec4-4b39-b3b2-283611a0752d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:36.556388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:36.557765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:36.558716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.559096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.559503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.571028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:36.579799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:36.580883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:36.581848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:36.588536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 137/275] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:36.589950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.609279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:36.633082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc71e2-8903-406e-b049-f7218628c007 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:36.673878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:36.674692 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.675074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.675447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.676253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:36.677825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:36.707738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe710cb-648f-4846-bd62-7eca45a55cd7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:36.740835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:36.741549 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.742118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.742409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.743097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:36.743396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:36.744778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:36.758346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 138/276] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:36.761427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.776432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 139/277] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:23:36 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:23:36.858770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:36.885228 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757eb22-1e2d-428a-be49-aa27741e93f0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:36.924261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:36.924690 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.925238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.925515 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] PATH_INFO: `/v3/users/89a3f48aeab244dd9016e1f637b1eaa3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.939979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] RBAC: Authorizing `identity:get_user(user_id=89a3f48aeab244dd9016e1f637b1eaa3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:36.941541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444925f4-0b08-418a-ac74-46d33926e3cb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:36.943612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 139/278] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:36 2022] GET /identity/v3/users/89a3f48aeab244dd9016e1f637b1eaa3 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:36.949743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:36.990758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab624-5d35-472e-b314-3ab2539c5940 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.990758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab624-5d35-472e-b314-3ab2539c5940 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.990758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab624-5d35-472e-b314-3ab2539c5940 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:36.992847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 140/279] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:36.997288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9f8b-c149-4fe6-8ba3-97d00dc3870b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:36.997579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9f8b-c149-4fe6-8ba3-97d00dc3870b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:36.997945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e9f8b-c149-4fe6-8ba3-97d00dc3870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.014648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-004e9f8b-c149-4fe6-8ba3-97d00dc3870b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:37.015836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-004e9f8b-c149-4fe6-8ba3-97d00dc3870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:37.067193 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:37.074734 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e144b3e-2b16-41af-961f-d118fd424ac4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.111404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 141/280] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:37.117376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa648f7-24df-4c25-8f10-19f8ba96a5b7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.117687 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa648f7-24df-4c25-8f10-19f8ba96a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.117958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa648f7-24df-4c25-8f10-19f8ba96a5b7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.119338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 142/281] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:37.120562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:37.121436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.121862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.122296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.123456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, user.id=89a3f48aeab244dd9016e1f637b1eaa3, scope.system=all) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:37.123917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:37.124344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.124673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.124958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.126179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:37.138292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:23:36 2022] GET /identity/v3/role_assignments?user.id=89a3f48aeab244dd9016e1f637b1eaa3&scope.system=all&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:37.139476 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:37.143437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:37.145737 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:37.243294 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:37.256501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 143/283] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:37.285672 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:37.303846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc949144-ab7b-4fab-bbda-3e62287b9c59 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.360334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:37.361387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.362465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.362742 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.383314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:37.391089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:37.392487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:37.393262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:37.400667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:37.406205 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:37.443452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:37.464957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54ab67-3a29-4781-8292-a3adea8162f3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:37.537094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.540424 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.540424 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.585387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:37.595383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:37.596275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:37.597117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:37.600527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 144/285] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:37.607440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:37.624847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065b349-b1aa-429c-a109-928248b08b40 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.697145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:37.697991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.698280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.698560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.699319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:37.699623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:37.701048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:37.738672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 142/286] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:37.745258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:37.747133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:37.830522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1683a-1e45-40e7-9830-77bf2e4426fb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.939296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:37.939296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:37.939296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:37.939296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:37.939717 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:37.939717 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:37.939835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:37.945195 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:37.962691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1edc07-cedb-4e19-9c95-6b5a9a6d2ee0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:37.971272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 145/287] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:37.980369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.045429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.046302 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.046577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.046854 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] PATH_INFO: `/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.055363 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] RBAC: Authorizing `identity:get_user(user_id=9d3ddf07b77d4c62a8228ea4a65cc9c0)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.059667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.071102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 143/288] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/users/9d3ddf07b77d4c62a8228ea4a65cc9c0 => generated 297 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:38.071953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.267865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95555-9a40-4704-a7ce-c0708c7e8f05 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:38.272124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0fee3-8940-4730-9d3f-a03d8fc9a67e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:38.300143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:38.333579 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.334943 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.335756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.336245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.337317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.337807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.338840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.339626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] PATH_INFO: `/v3/users/7ffc700ea1dc4d1e93b0fa414a638250` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.343692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] RBAC: Authorizing `identity:get_user(user_id=7ffc700ea1dc4d1e93b0fa414a638250)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.345437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.351437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 146/289] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:37 2022] GET /identity/v3/users/7ffc700ea1dc4d1e93b0fa414a638250 => generated 297 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:38.359504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.379522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:38.472194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.473609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.530338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79b684-7f8d-442c-b504-aa9919cc9bbe None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:38.588119 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.588995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.589279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.589551 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.590830 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.592276 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.596331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:38 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:38.600451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.650221 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:38.655191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.692756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:38.739338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:38.777763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1f3db-cb77-4ef5-bd56-2500d32970a0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:38.826598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bf745-32b2-4f66-a10d-e2868eb789f6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:38.838254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.839144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.839422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.839686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/users/7ffc700ea1dc4d1e93b0fa414a638250/roles/ea6e90da441843fca19f1bb7502ab8fa` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.844695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, user_id=7ffc700ea1dc4d1e93b0fa414a638250, role_id=ea6e90da441843fca19f1bb7502ab8fa)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.846148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9be217-01bc-4434-a8fd-370b667e380d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.875535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:38.876477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:38.876759 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:38.877033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:38.878300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:38.879779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:38.881930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 145/292] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:38 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:38.887340 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:38.961981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 148/293] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:23:38 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/users/7ffc700ea1dc4d1e93b0fa414a638250/roles/ea6e90da441843fca19f1bb7502ab8fa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:38.997438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb7c78-8d1c-474c-bd8e-0e50855d4f33 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:39.022092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:39.046589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:39.047882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.048165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.048453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.049296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=9d3ddf07b77d4c62a8228ea4a65cc9c0) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:39.049607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:39.051059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e638b-17b3-4fd1-b083-b481b47cc7ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:39.061800 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 146/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:38 2022] GET /identity/v3/role_assignments?user.id=9d3ddf07b77d4c62a8228ea4a65cc9c0&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:39.429652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67db0-333d-4b87-a7ee-59941dd524a2 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.429985 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67db0-333d-4b87-a7ee-59941dd524a2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.430204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67db0-333d-4b87-a7ee-59941dd524a2 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.431575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 149/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:39.438613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9cda-5081-4a30-8e09-6b01ce903c38 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.439109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9cda-5081-4a30-8e09-6b01ce903c38 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.439186 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc9cda-5081-4a30-8e09-6b01ce903c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.445264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2823-18ca-4469-8fee-8ec67d6c0943 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.445548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2823-18ca-4469-8fee-8ec67d6c0943 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.445823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2823-18ca-4469-8fee-8ec67d6c0943 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.447183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 150/296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:39.458503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.459072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.459527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.460898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7afc9cda-5081-4a30-8e09-6b01ce903c38 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:39.462618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7afc9cda-5081-4a30-8e09-6b01ce903c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:39.481773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:39.483372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:39.544784 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 147/297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:39.552538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa48ff1-69c3-4910-ad50-5d457c5ab5f3 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.552538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa48ff1-69c3-4910-ad50-5d457c5ab5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.552538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa48ff1-69c3-4910-ad50-5d457c5ab5f3 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.552538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 148/298] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:39.553134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.553412 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.553682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.567361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 151/299] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:39.571345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:39.572823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:39.574240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:39.628646 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:39.653346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 149/300] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:39.654197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:39.694394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332089-dc5a-4df8-a7b2-acd7a0abbc6c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:39.702764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:39.729968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:39.730753 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.731031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.731297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.741316 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:39.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:39.750053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:39.751387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:39.755670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 152/301] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:39.756540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:39.767837 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c227512-2b0c-443d-8e23-cd490b25c6cb None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:39.805105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:39.806289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.806801 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.807266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.819660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:39.828235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:39.829329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:39.830224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:39.832607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 150/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:39.833630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:39.862491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e41f-d200-4534-b68d-fedd21055794 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:39.864034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:39.895604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:39.896416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.896710 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.897000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.898536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:39.900276 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:39.902433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 153/303] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:39.903386 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:39.943808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:39.947052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9c16d-dd59-4e81-ad0e-0022de69e627 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:39.979879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:39.980576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:39.980858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:39.981129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:39.981865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:39.982225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:39.983649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:39.998408 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 151/304] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:39.998408 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:40.006905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4e172-1976-4a05-8e87-c82fb893bdc4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.042986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.043648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.043928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.044200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.045067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:40.045369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.046836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.060367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 154/305] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:40.060367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:40.091923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:40.105057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d12-6deb-46cb-9ca6-4072d8c5a97b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.141536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.142256 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.142536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.142806 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] PATH_INFO: `/v3/groups` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.143483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.144953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.162880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b776bd-667e-4eb9-9d9b-3bc2846a6f4f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.198616 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.199423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.208814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.209023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 152/306] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 22:23:39 2022] POST /identity/v3/groups => generated 229 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:40.209115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] PATH_INFO: `/v3/users/faac449dd27048488157f8bea3a4da0f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.209188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:40.229248 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] RBAC: Authorizing `identity:get_user(user_id=faac449dd27048488157f8bea3a4da0f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.231305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.236586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 155/307] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:40 2022] GET /identity/v3/users/faac449dd27048488157f8bea3a4da0f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:40.240741 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:40.248321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:40.336388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c334d-dd4a-42a8-bdb5-f7818bb8e6fa None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.371798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:40.378060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.378985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.379263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.379532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] PATH_INFO: `/v3/users/89a3f48aeab244dd9016e1f637b1eaa3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.381602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] RBAC: Authorizing `identity:get_user(user_id=89a3f48aeab244dd9016e1f637b1eaa3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.383113 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.385945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243daba4-bebf-4191-80fd-2660ea1799a8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.386064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 153/308] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:40 2022] GET /identity/v3/users/89a3f48aeab244dd9016e1f637b1eaa3 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:40.390396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:40.424730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.425386 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.425672 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.425939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.426772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, user.id=faac449dd27048488157f8bea3a4da0f, scope.system=all) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:40.427083 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.429010 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09b27-aad9-464b-bb3f-f23501473f57 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.435045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 156/309] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:23:40 2022] GET /identity/v3/role_assignments?user.id=faac449dd27048488157f8bea3a4da0f&scope.system=all&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:40.499151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:40.509460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a378ee-5b0c-4ca9-97d0-3b313cbd5298 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:40.546449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:40.547870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:40.548150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:40.548441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] PATH_INFO: `/v3/system/users/89a3f48aeab244dd9016e1f637b1eaa3/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:40.550342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=89a3f48aeab244dd9016e1f637b1eaa3, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:40.551904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c70f76-4539-4200-8fb5-ea4958851c26 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:40.634923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 154/310] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 22:23:40 2022] PUT /identity/v3/system/users/89a3f48aeab244dd9016e1f637b1eaa3/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:23:41.219775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac331-1d9d-4d79-aee5-b371c5ea01d0 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.220271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac331-1d9d-4d79-aee5-b371c5ea01d0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.220376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fac331-1d9d-4d79-aee5-b371c5ea01d0 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.221981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 157/311] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:41.227300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.227598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.227881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.245389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:41.246562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:41.320516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 155/312] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:41.339479 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fac331-1d9d-4d79-aee5-b371c5ea01d0 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:41.443573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fac331-1d9d-4d79-aee5-b371c5ea01d0 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:41.480388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:41.481545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.482046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.482533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.493479 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:41.501330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:41.502245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:41.503017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:41.505624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 158/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:41.513577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:41.601109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:41.617537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f020-14a9-46c7-b4e6-0d51c297971e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:41.651918 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:41.652610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.652892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.653164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.653898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:41.654197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:41.655649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:41.664715 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 156/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:41.670567 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:41.687106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:41.780266 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27468c-033b-4135-a0eb-c4b27425f248 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:41.814861 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:41.815734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.816015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.816289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] PATH_INFO: `/v3/users/7ffc700ea1dc4d1e93b0fa414a638250` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.817569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] RBAC: Authorizing `identity:get_user(user_id=7ffc700ea1dc4d1e93b0fa414a638250)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:41.819003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:41.821012 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 159/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:41 2022] GET /identity/v3/users/7ffc700ea1dc4d1e93b0fa414a638250 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:41.826415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:41.936688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656944c6-58db-428f-986a-d880c2cf577a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:41.971948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:41.972618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:41.972898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:41.973168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:41.988389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.041722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:42.043119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:42.143136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 157/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:42.148485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.245629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.261629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6391919-3b26-4375-848d-3f5bcfb97afa None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:42.295300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:42.296081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.296361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.296666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.298436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:42.299866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28b92f-804d-472a-9bda-ce765a9e0db1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:42.301902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 160/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:42 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:42.307429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.356393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.414253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce046e0-c343-49cc-a603-b2f26e7afbb3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:42.449505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:42.450433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.450853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.451264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.452216 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, scope.project.id=2197aece67714272b454f81e99b5873d, user.id=7ffc700ea1dc4d1e93b0fa414a638250) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:42.452705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:42.454324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335b831-eab0-4ecf-80e5-04c17825c71c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:42.460810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 158/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:23:42 2022] GET /identity/v3/role_assignments?user.id=7ffc700ea1dc4d1e93b0fa414a638250&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:42.476623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec35b-fb7d-450a-95c9-b2344286f1d6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.477069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec35b-fb7d-450a-95c9-b2344286f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.477449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beec35b-fb7d-450a-95c9-b2344286f1d6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.480485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 161/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:42.485926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.486344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.486718 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.501771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47591-e75d-4070-ad38-bcaec119e0a9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.502124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47591-e75d-4070-ad38-bcaec119e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.502325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47591-e75d-4070-ad38-bcaec119e0a9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.503761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 162/320] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:42.507854 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:42.509278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:42.509575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.509970 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.510350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.528052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:42.529701 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:42.598651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 159/321] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:42.612151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:42.628191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.639896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.686485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.738385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.757831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd882f-7229-45a1-9343-18e9c332041d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:42.758991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb26bb2-628b-488a-a596-5a2c449dc560 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:42.792005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:42.792567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:42.792823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.793105 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.793375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.793462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.793702 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.793980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.795123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:42.796633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497e6c8-14b0-4067-be67-92ed9ccd28d6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:42.799021 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 160/323] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:23:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:42.799982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1701e5-3387-4d62-b768-fd3c1a71c826 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.800261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1701e5-3387-4d62-b768-fd3c1a71c826 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.800557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1701e5-3387-4d62-b768-fd3c1a71c826 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.801761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 161/324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:42.806438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1701e5-3387-4d62-b768-fd3c1a71c826 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.807313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4a919fcb-ea15-4cc3-9715-8b54166cb003 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:42.815695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:42.816981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:42.817790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 164/325] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:42.818620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213106-2b35-4764-aab3-558369f191ad None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.818620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213106-2b35-4764-aab3-558369f191ad None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.818620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e213106-2b35-4764-aab3-558369f191ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.835355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1e213106-2b35-4764-aab3-558369f191ad None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:42.836559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1e213106-2b35-4764-aab3-558369f191ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:42.902146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 165/326] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:42.902698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e213106-2b35-4764-aab3-558369f191ad None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:42.917000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1701e5-3387-4d62-b768-fd3c1a71c826 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:42.927565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.951871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:42.952567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:42.952852 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:42.953128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] PATH_INFO: `/v3/groups` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:42.953836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:42.955351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:42.969924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:42.999386 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e213106-2b35-4764-aab3-558369f191ad None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.031897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.032580 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.032865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.033141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.033880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:43.034242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.035601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.040855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 162/327] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 22:23:42 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:23:43.052740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.052835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 166/328] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:43.052835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.159813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf2d06-a835-436b-bd68-e709679cc9d0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.166751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7f7fe-e038-494b-8bca-dbe03fe45311 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.202477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.203316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.203939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.203939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.205485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:43.212176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.213934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.213934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.213934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] PATH_INFO: `/v3/users/faac449dd27048488157f8bea3a4da0f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.215481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] RBAC: Authorizing `identity:get_user(user_id=faac449dd27048488157f8bea3a4da0f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.216509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.218414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 167/329] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:43 2022] GET /identity/v3/users/faac449dd27048488157f8bea3a4da0f => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:43.221516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:43.224689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:43.230147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:43.231035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:43.231826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 163/330] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:43.238675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.272789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:43.351874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52fbb-024a-4bb4-b51f-abc7dba6f06d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.362552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e58f4d-d4a5-4648-9fc4-e5d84f5d448d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.389430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.390531 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.392035 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.392035 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] PATH_INFO: `/v3/system/users/faac449dd27048488157f8bea3a4da0f/roles/ea6e90da441843fca19f1bb7502ab8fa` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.393177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=faac449dd27048488157f8bea3a4da0f, role_id=ea6e90da441843fca19f1bb7502ab8fa)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.394624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.405709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.406419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.406765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.413200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.413200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:43.413200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.413200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.418666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 164/331] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:43.424321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.464927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 168/332] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 22:23:43 2022] PUT /identity/v3/system/users/faac449dd27048488157f8bea3a4da0f/roles/ea6e90da441843fca19f1bb7502ab8fa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:23:43.532871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:43.542448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f9adf9-7967-46a3-9ad6-d39a6dc8b42c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.581905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.582798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.583074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.583396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] PATH_INFO: `/v3/users/89a3f48aeab244dd9016e1f637b1eaa3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.584659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] RBAC: Authorizing `identity:get_user(user_id=89a3f48aeab244dd9016e1f637b1eaa3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.586129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c1242-5260-4b1e-892f-0f2688bb6b32 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.588132 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 165/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:43 2022] GET /identity/v3/users/89a3f48aeab244dd9016e1f637b1eaa3 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:43.594139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:43.669872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:43.714181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab328965-3941-4292-a46e-1505d639a9f4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:43.757984 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:43.758644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:43.758930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:43.759205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:43.760042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] RBAC: Adding query filter params (role.id=f0fa45a74bbf41ba9d093d0b23ccc053, user.id=89a3f48aeab244dd9016e1f637b1eaa3, scope.system=all) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:43.760355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:43.761824 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c248bee-3484-437f-8a93-57587b05b17b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:43.775684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 169/334] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:23:43 2022] GET /identity/v3/role_assignments?user.id=89a3f48aeab244dd9016e1f637b1eaa3&scope.system=all&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:45.444323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2733-47a0-41cc-9e05-7d940019b950 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.445397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2733-47a0-41cc-9e05-7d940019b950 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.445894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2733-47a0-41cc-9e05-7d940019b950 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.447463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 166/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:45.452720 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.453685 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.453879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.474805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:45.475997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:45.554296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:45.587394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2733-47a0-41cc-9e05-7d940019b950 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:45.714994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2733-47a0-41cc-9e05-7d940019b950 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:45.752716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:45.753930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.754789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.755229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.766977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7c29aac6-1bee-41d2-925d-641e710e7989 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:45.783842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:45.784857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:45.785672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:45.788166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 167/337] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:45.794140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:45.871923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:45.925041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df4a98-7e86-457a-9623-a54475d7b9c8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:45.953831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076a49-5e7b-4cd3-997a-7c0ae5449490 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.954578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076a49-5e7b-4cd3-997a-7c0ae5449490 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.955075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f076a49-5e7b-4cd3-997a-7c0ae5449490 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.956723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 168/338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:23:45.961947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5664bb-3b81-4c93-86e3-ef75cd69e553 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.962238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5664bb-3b81-4c93-86e3-ef75cd69e553 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.962517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5664bb-3b81-4c93-86e3-ef75cd69e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.970057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:45.970678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:45.970960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:45.971239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:45.971989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:45.972295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:45.973729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:45.988358 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 171/339] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:45.998438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.001532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-1a5664bb-3b81-4c93-86e3-ef75cd69e553 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:46.002728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-1a5664bb-3b81-4c93-86e3-ef75cd69e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:46.030225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.161988 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 169/340] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:46.163332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b749-9ad3-4e98-bd67-e1d80b6ce91c None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.163619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b749-9ad3-4e98-bd67-e1d80b6ce91c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.163897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b749-9ad3-4e98-bd67-e1d80b6ce91c None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.165645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 170/341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:46.180008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.180289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.180601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.186628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783520a-7756-4907-9f65-baa76b8f3880 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:46.207823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:46.209024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:46.221424 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.254304 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:46.254957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.255240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.255519 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.335222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 171/342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:46.336435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.358655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:46.360994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:46.488268 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.499552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 172/343] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:46.501217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.516774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.550538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073228-19f6-4df0-baf8-2dd38ba42fdc None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:46.613684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870e51-d2b4-4413-9749-61d9ee89f37e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:46.614109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:46.615019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.615398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.615797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.627483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:46.636483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:46.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:46.638260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:46.641211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 172/344] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:46.642201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.657791 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:46.658615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.658903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.659174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.670274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f89af77e-2c8f-48a6-b323-d5d7ec6f2150 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:46.678380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:46.679387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:23:46.680216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:46.683080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 173/345] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:46.684513 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e64b8-60e4-4e9f-b153-874b45c34fbf None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.684967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e64b8-60e4-4e9f-b153-874b45c34fbf None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.685550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e64b8-60e4-4e9f-b153-874b45c34fbf None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.687008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 174/346] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:46.687907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e64b8-60e4-4e9f-b153-874b45c34fbf None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.763814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a168c8-c64f-40e0-8024-b9a90225bd4a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:46.772510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.799818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e64b8-60e4-4e9f-b153-874b45c34fbf None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:46.802027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:46.803118 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.803617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.804098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.805649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:46.807390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0618f-7ac4-483e-b11a-3fce63016c23 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:46.810055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 173/347] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:46.811805 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.812359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.817942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.832816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:46.837911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:46.839382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:46.889524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:46.890389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:46.891316 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:46.891601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:46.892360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:46.895919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:46.897807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:46.908245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 175/348] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:46.913264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:46.926740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 174/349] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:46.927591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.043602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420e88e-a271-472c-a184-b9bde1b54354 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.061678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e86ef-036e-4065-a0e9-577377ec2176 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.078846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.079518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.079803 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.080082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.080866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:47.081173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.082566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.084868 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.092500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 176/350] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.093319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.104686 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.105507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.105786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.106059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.110259 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.114620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.116128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.118388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 175/351] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:46 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.119237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.237572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fb2b-0dbd-41bb-8dee-3b6f26f2530c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.258430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fd53a-3973-46dc-bbb8-480a2c53f4a1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.282909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.283573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.283854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.284129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.303225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.303952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.304235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.304557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.316359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:47.324077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:47.324979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:47.325788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 176/352] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:47.326433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.354770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.360313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.362174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.396267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.457584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb031b-731b-42fd-ac20-ba79cb4703f1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.483251 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 177/353] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:47.487452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.508729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.509605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.509889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.510168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] PATH_INFO: `/v3/users/faac449dd27048488157f8bea3a4da0f` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.511810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] RBAC: Authorizing `identity:get_user(user_id=faac449dd27048488157f8bea3a4da0f)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.514270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b046bc-9a52-461c-a9f4-43a80ffa3286 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.515273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 177/354] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/users/faac449dd27048488157f8bea3a4da0f => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.517949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597016e4-7cda-4937-a88a-29022ac54f34 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.517949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597016e4-7cda-4937-a88a-29022ac54f34 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.517949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597016e4-7cda-4937-a88a-29022ac54f34 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.518519 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 178/355] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:47.523236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597016e4-7cda-4937-a88a-29022ac54f34 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.617096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.622329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6423-03e7-46a3-b607-1be26509ee72 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.653729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597016e4-7cda-4937-a88a-29022ac54f34 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.663330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.663997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.664281 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.664587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.665421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:47.666106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.667870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.674207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 178/356] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.675095 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.690215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.702243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.703814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.704829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.705585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.706573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:47.707251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.709798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.722799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 179/357] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.724567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.808475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17061575-66ea-4753-8c82-8fa067c86c15 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.853539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.854503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.854786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.855063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.856296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.857808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541abaf1-cb52-4ea7-aec1-01b982deac78 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.860138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 179/358] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.861513 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b6b1-801b-45d3-88b7-748a60ebfb86 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.861800 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b6b1-801b-45d3-88b7-748a60ebfb86 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.862076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b6b1-801b-45d3-88b7-748a60ebfb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.873618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92c0a-cbb0-4d7f-8040-e6e6494d4782 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:47.880673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6927b6b1-801b-45d3-88b7-748a60ebfb86 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:47.881962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6927b6b1-801b-45d3-88b7-748a60ebfb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:47.911051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:47.917382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:47.917944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.918956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.919402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.920134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] RBAC: Adding query filter params (role.id=ea6e90da441843fca19f1bb7502ab8fa, user.id=faac449dd27048488157f8bea3a4da0f, scope.system=all) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:47.921009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:47.925619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:47.941760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 180/359] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/role_assignments?user.id=faac449dd27048488157f8bea3a4da0f&scope.system=all&role.id=ea6e90da441843fca19f1bb7502ab8fa => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:47.942075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:47.973707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 180/360] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:47.976010 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8972-dfc9-494c-a46d-88a5c94fd40f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:47.976576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8972-dfc9-494c-a46d-88a5c94fd40f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:47.977076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b8972-dfc9-494c-a46d-88a5c94fd40f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:47.979838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 181/361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:47.980984 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8972-dfc9-494c-a46d-88a5c94fd40f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.060796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.087201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184b20-668a-421f-bda9-56bdf640fb28 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.128081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b8972-dfc9-494c-a46d-88a5c94fd40f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.142217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.142873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.143156 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.143431 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.184826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.185688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.185964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.186244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.189591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.191045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73982ed8-52de-41b9-b46b-85330d072ebb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.194836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 182/362] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:48.197842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.198344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.198812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.220591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:48.222123 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:48.248668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.250314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.250558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.316114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.319865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 183/363] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:48.321675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.381832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:48.382736 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.446741 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ff1ce-15a7-47da-aa22-0ab923d577f2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.494149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.494962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.495240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.496189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.511216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:48.517372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f898d0-ac1f-4a32-b2a8-aab93736eac4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:48.519983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:48.521148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:48.522050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 184/365] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:48.522722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.544726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.568574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.569367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.569718 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.570063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.570953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:48.571349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.572909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.582327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 182/366] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:48.583209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.600816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.665460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0c3a-a49d-46da-b7d8-04ecdba848b6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.717345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.718696 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.719062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.719398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.727751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7ee9e-cbd3-46e5-b627-768b4cc9ddee None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.734385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:48.744816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:48.746070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:48.747070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:48.752486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 185/367] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:48.752486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.784909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.785933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.787344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.787646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.789120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.791009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.793364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 183/368] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:48.795024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.852045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.879384 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1d422-d747-4fb7-997a-c922009e19ac None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.909689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:48.923328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.923928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.924213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.924514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.925337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:48.925669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.928225 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.932662 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b4a88-13ad-4b45-b539-13b7d93b5b0c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:48.939342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 186/369] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:48.940274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:48.980120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:48.980840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:48.981123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:48.981401 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:48.982166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:48.982471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:48.983859 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:48.999770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 184/370] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.001188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.054876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5178d9-86c6-4da7-a9d2-73533efc688d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.092449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.093469 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.093763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.094128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.095392 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.097101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.099094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 187/371] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.100108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.102925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b325155-97f4-427c-a18c-0be2d296ee0a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.114019 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.139739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.140441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.140747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.141022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.154504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.213616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.215088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.217122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9602d54-c7f0-43e6-b45a-324ec1b22bb2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.255060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.256084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.256561 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.256984 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.317873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 185/372] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:49.319053 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.333328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.335207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.346192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.363455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.420709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48375607-b18a-4547-8f5a-260316c22c72 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.446592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:49.447932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.462832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.463732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.464184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.464627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.465595 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=2197aece67714272b454f81e99b5873d) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:49.466048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.467634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.473905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 186/374] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.474886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.590198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea172-2d2e-4814-bf92-ff89f0b38d68 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.598371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12bf49-03d6-409d-a3db-b8b0431c4a84 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.599329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.610692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.632430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.632430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.632430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.632430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] PATH_INFO: `/v3/projects/d834971bff2f4ef9b259002b3b3122c9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.632857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] RBAC: Authorizing `identity:get_project(project_id=d834971bff2f4ef9b259002b3b3122c9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.633316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.639769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 187/375] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/projects/d834971bff2f4ef9b259002b3b3122c9 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.645638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.671032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.672434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.672708 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.672981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.674948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.676554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.678428 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 189/376] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.685350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.779770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4f998-087e-41c4-bab9-0f17b356fb2e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.821422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cc644-d2f3-4ba1-a557-e74d6c83ac35 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:49.824470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.825573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.826051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.826515 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] PATH_INFO: `/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.832732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] RBAC: Authorizing `identity:get_group(group_id=5dbdfd8bf8b54d42bf82d3a6de7fb503)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.834502 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.836698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 188/377] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:49.847359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.881638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:49.882904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:49.883377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:49.883886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:49.885891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:49.888480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:49.894237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 190/378] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:49.914288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:49.934414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:49.995947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:50.050001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58818f3-5ced-438d-8e16-957e8b76d257 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:50.093031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856136d-0779-41b4-b45d-c7117e30068d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:50.112780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:50.113807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.114302 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.114781 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.115844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] RBAC: Adding query filter params (group.id=5dbdfd8bf8b54d42bf82d3a6de7fb503, role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=d834971bff2f4ef9b259002b3b3122c9) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:50.116364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:50.118803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdba42e-6f05-45fd-b863-2d5a9af320fb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:50.125742 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 189/379] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/role_assignments?group.id=5dbdfd8bf8b54d42bf82d3a6de7fb503&scope.project.id=d834971bff2f4ef9b259002b3b3122c9&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:50.153219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:50.153896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.154181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.154457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.155374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=2197aece67714272b454f81e99b5873d) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:50.155693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:50.157284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00e660-d4ac-478a-86d3-c5a7d29ac474 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:50.166633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 191/380] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:49 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:50.194335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988e29-73aa-4c6d-a099-cd1caced8669 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.194615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988e29-73aa-4c6d-a099-cd1caced8669 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.195690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988e29-73aa-4c6d-a099-cd1caced8669 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.196677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 190/381] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:50.202706 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.203585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.203948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.223543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:50.224890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:50.313615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:50.336579 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988e29-73aa-4c6d-a099-cd1caced8669 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:50.482192 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988e29-73aa-4c6d-a099-cd1caced8669 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:50.484921 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:50.519715 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:50.520780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.521295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.521706 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.533201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:50.541290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:50.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:50.543447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:50.545497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 191/383] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:50.556652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:50.607039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:50.686349 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459ad88-4c2c-4df6-b49c-d2ab627fac7d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:50.728444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:50.729129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.729412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.729692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.730451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:50.730757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:50.732146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:50.748979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 193/384] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:50.754843 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:50.894812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f07667-2612-4e21-b6e1-de176b5f3ed2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:50.936344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:50.937264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:50.937544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:50.937877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:50.945155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:50.946631 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8fa43-d422-4d60-a122-7836ed38db33 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:50.948301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 192/385] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:50 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:50.956929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.075861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613482-de95-495c-819f-162b597088d3 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.076169 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613482-de95-495c-819f-162b597088d3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.076441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc613482-de95-495c-819f-162b597088d3 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.078839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 193/386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:51.084538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.085010 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.085296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.094949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:51.098300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7557-ccad-4272-b515-898fed36a2f7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:51.113698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:51.114907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:51.150017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:51.150795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.151076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.151351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.155250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:51.157289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:51.159173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 194/387] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:50 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:51.163945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:51.164681 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.250880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 194/388] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:51.295494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.341624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ec31e-84ba-4543-8ef3-1b524e757511 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:51.418333 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:51.419161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.419447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.419732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.421973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, group_id=df9cb85ef2294b52ad2118ec3ebcdbd9, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:51.423425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:51.439183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6729f-8866-4542-9970-14febc45ea60 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:51.476897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:51.478179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.479430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.479951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.493598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:51.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:51.503791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:51.504606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:51.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 195/389] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:51.513558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.514594 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 195/390] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:23:51 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:23:51.538749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:51.634730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90795c-2243-4173-9b90-2fed7ca0b1d3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:51.679272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:51.679856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.680136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.680440 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.681194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:51.681497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:51.682914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:51.696581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 196/391] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:51.702254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.732916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:51.816926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daac91-a052-4963-b6a8-90a8f1dfe5f7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:51.856022 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:51.856987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:51.857314 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:51.857593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:51.858736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:51.860776 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:51.862400 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 196/392] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:51 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:51.868182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:51.962762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:51.987461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dd531-32f1-4ce7-a890-8e3ca36e27ab None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:52.025419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:52.026283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.026560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.026830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.028021 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:52.029494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c416c-b8f0-47f4-8777-03ce0bb56220 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:52.031514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 197/393] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:51 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:52.037785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:52.179513 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:52.191632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc319-73b9-4c88-816d-cdab2e8c6e0c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:52.241331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:52.242399 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.242684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.242961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.246277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c085d2a094c45ba95fd2ac7bec7294d, group_id=df9cb85ef2294b52ad2118ec3ebcdbd9, role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:52.247729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e68b6-1319-43ed-ab2e-cc283db67415 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:52.325910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 197/394] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:23:52 2022] PUT /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/1e933b37fb62445f9e9755ca954a80cd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:23:52.446383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ac5-c56a-42b0-82f0-c76fd62e007b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.446729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ac5-c56a-42b0-82f0-c76fd62e007b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.447071 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61400ac5-c56a-42b0-82f0-c76fd62e007b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.448700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 198/395] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:52.454156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051809e-a169-4fff-bf54-dde537578054 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.454451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051809e-a169-4fff-bf54-dde537578054 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.454740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051809e-a169-4fff-bf54-dde537578054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.477599 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7051809e-a169-4fff-bf54-dde537578054 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:52.478833 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7051809e-a169-4fff-bf54-dde537578054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:52.558420 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 198/396] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:52.588553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ac5-c56a-42b0-82f0-c76fd62e007b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:52.738034 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61400ac5-c56a-42b0-82f0-c76fd62e007b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:52.784436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:52.785622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.786207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.786701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.802952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-86d89d59-ea2e-416b-a725-2960c9a6882e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:52.811247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:52.812176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:52.812994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:52.815566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 199/397] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:52.824794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051809e-a169-4fff-bf54-dde537578054 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:52.847862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159742-0f8c-4e09-9dcf-5011eb5aa231 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.848521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159742-0f8c-4e09-9dcf-5011eb5aa231 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.849029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b159742-0f8c-4e09-9dcf-5011eb5aa231 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.850937 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 200/398] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:52.855683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851bd5-4564-495b-b127-845d2df59374 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:52.855974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851bd5-4564-495b-b127-845d2df59374 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:52.856258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03851bd5-4564-495b-b127-845d2df59374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:52.882238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-03851bd5-4564-495b-b127-845d2df59374 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:52.883414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-03851bd5-4564-495b-b127-845d2df59374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:52.896711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:52.963085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:52.994435 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051809e-a169-4fff-bf54-dde537578054 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.027018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 201/399] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:53.037421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.038178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.038523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.038865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.039683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:53.040046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.041528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.051095 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 199/400] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:53.056985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03851bd5-4564-495b-b127-845d2df59374 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.062939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.194618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03851bd5-4564-495b-b127-845d2df59374 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.230226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.231077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.231352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.231617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.232808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.233532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921e3f3-1257-45eb-8c32-85438c0d8329 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.234880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f2b0-d734-4e63-8fc9-f029d074ba83 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.236922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 202/401] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:53.238095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9685d-fa23-4768-90f9-466a1790a301 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.238375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9685d-fa23-4768-90f9-466a1790a301 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.238644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9685d-fa23-4768-90f9-466a1790a301 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.244649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 203/402] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:53.245413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9685d-fa23-4768-90f9-466a1790a301 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.256079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.273251 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.274050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.274336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.274614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.285920 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-439c06f9-2354-4f6c-92d9-ace7c8e96fb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:53.294837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:53.295942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:53.297571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:53.301456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:53.302835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.303126 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.303409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.321070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:53.322822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:53.340829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.358283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9685d-fa23-4768-90f9-466a1790a301 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.394235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.395485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.395956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.396449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.398270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.400793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 201/404] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:53.401126 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.401678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.408034 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:53.409183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.488064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.512086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2e87-6311-4275-8d74-f6d776828e68 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.527406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116fca8-b81b-48a2-b417-4bf505908b7f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.547829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.549087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.549607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.550069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/f0fa45a74bbf41ba9d093d0b23ccc053` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.552212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, group_id=df9cb85ef2294b52ad2118ec3ebcdbd9, role_id=f0fa45a74bbf41ba9d093d0b23ccc053)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.553855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.563302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.563972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.564253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.564582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.565319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:53.565639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.567127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.576567 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.578813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:53.579817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.647470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 205/407] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:23:53 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/f0fa45a74bbf41ba9d093d0b23ccc053 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:53.649177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.719286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa39cd4-058d-44d8-94f5-2cba610df229 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.797179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.798307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.798593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.798871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.819143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:53.830184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:53.831463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:53.832254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 203/408] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:53.840224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.849560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1bcc1-6ab2-4b0f-a7ba-c345e59d49d6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:53.893314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:53.894269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:53.894545 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:53.894811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] PATH_INFO: `/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:53.896117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] RBAC: Authorizing `identity:get_group(group_id=5dbdfd8bf8b54d42bf82d3a6de7fb503)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:53.897920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:53.906331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503 => generated 229 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:53.920955 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.923224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:53.929748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:53.969550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07098553-c7dd-4824-92cc-e936de4cfd11 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.005991 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.006664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.006951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.007238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.007986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:54.008296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.009924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392083-49e6-4880-94d8-4f281d182588 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.019232 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:54.021128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac1f9-b18e-4c8a-a042-28432ad62029 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.021420 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac1f9-b18e-4c8a-a042-28432ad62029 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.021743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac1f9-b18e-4c8a-a042-28432ad62029 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.023255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 205/411] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:54.024516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac1f9-b18e-4c8a-a042-28432ad62029 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.066179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a64d45-7212-4a93-9b2c-f1ff30aabcd2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.109136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.109932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.110214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.110489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] PATH_INFO: `/v3/projects/d834971bff2f4ef9b259002b3b3122c9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.111705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] RBAC: Authorizing `identity:get_project(project_id=d834971bff2f4ef9b259002b3b3122c9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.113649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffda1dc-1ccb-42fb-9dbe-38caaa5a2832 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.116335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 207/412] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:53 2022] GET /identity/v3/projects/d834971bff2f4ef9b259002b3b3122c9 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:54.117809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.118098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.118380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.140637 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:54.142624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:54.148597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac1f9-b18e-4c8a-a042-28432ad62029 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.175335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:54.197149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.198204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.198499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.198778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.200006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.201494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.204003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 206/413] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:54.204802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.235835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 208/414] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:54.236785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.239064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:54.339448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19f28-df20-4f72-9a17-891513c18881 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.366318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b1473-e7e7-42a6-97f8-b9177a957da3 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.374408 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.375419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.375783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.376182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] PATH_INFO: `/v3/projects/d834971bff2f4ef9b259002b3b3122c9/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.378299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] RBAC: Authorizing `identity:create_grant(project_id=d834971bff2f4ef9b259002b3b3122c9, group_id=5dbdfd8bf8b54d42bf82d3a6de7fb503, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.379908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.404880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.406315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.406655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.406934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.408156 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.409721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.411645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:54.416372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.455594 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 207/416] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:23:54 2022] PUT /identity/v3/projects/d834971bff2f4ef9b259002b3b3122c9/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:54.456798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.538369 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:54.589360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:54.606567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35491d3-047c-4ee1-8c88-217618ecba40 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.670711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.671473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.671750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.672019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.673344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dc0cc-aa10-432e-a427-7a583f82c071 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.684847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:54.695080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:54.695978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:54.696846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 210/417] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:54.704250 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.721080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.722094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.722375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.722648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.725038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] RBAC: Authorizing `identity:create_grant(project_id=2197aece67714272b454f81e99b5873d, group_id=df9cb85ef2294b52ad2118ec3ebcdbd9, role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.726467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f77c6-f248-4e33-974f-36ceb749b55f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.795183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 208/418] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:23:54 2022] PUT /identity/v3/projects/2197aece67714272b454f81e99b5873d/groups/df9cb85ef2294b52ad2118ec3ebcdbd9/roles/1e933b37fb62445f9e9755ca954a80cd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:23:54.795183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53e06-0cab-49ee-a4d6-8caeb134ed7f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.795183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53e06-0cab-49ee-a4d6-8caeb134ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.795183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b53e06-0cab-49ee-a4d6-8caeb134ed7f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.795183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 209/419] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:54.801177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.801730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.802152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.825300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:54.826887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:54.841096 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91894f2-73c6-49c2-ab91-6b7cfc7b857b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:54.899660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:54.909907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:54.911004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:54.920234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:54.920234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:54.920234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] RBAC: Adding query filter params (name=member) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:54.920234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:54.920234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:54.920973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 210/420] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:54.931614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 211/421] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:54.938852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.949531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:54.988345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:55.059412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323fff2-4f4e-42cf-9838-655c1e5e571f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.109676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.110335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.110619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.110894 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.132893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a2e68-de52-49f1-9ebb-f0cbeb77b16a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.167861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.169038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.169555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.170027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.205052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:55.208297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:55.209818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:55.213099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:55.213976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:23:55.215258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 212/422] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:55.221308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:55.254746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:55.316999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 211/423] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:55.323671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:55.355661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:55.453701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa893c-e461-4073-8ba8-3ea56cbf2f5d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.522092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.522372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.522645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.523388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:55.523691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:55.525090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:55.527558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97446c-5778-45b6-877f-9cffcb1ead25 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.546853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 213/424] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:55.568449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:55.602626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.603681 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.603960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.604278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.606729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:55.610684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:55.615343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 212/425] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:55.618466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:55.641041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:55.750183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaedf7-f2ff-4f0a-8d72-1c6ab951c015 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.765083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:55.786582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.787634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.788137 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.788692 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.795636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6622e-66c8-4e86-a1da-af5d5393f95e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:55.863047 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:55.864992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:55.885673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:55.886545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:55.886820 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:55.887091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:55.888369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:55.889929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:55.896348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 213/426] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:55.913811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:55.979951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 214/427] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:55.985653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.001609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.063383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.088084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d978f-114e-4c49-9ce5-6fbf6bf4b3b2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.094964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21e923-83e4-4db6-9470-6c6d84c86475 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.133786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.134634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.134913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.135185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] PATH_INFO: `/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.136826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] RBAC: Authorizing `identity:get_project(project_id=1c085d2a094c45ba95fd2ac7bec7294d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:56.138292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a363db-5b34-48eb-bed1-5bd783d01943 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:56.140803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/projects/1c085d2a094c45ba95fd2ac7bec7294d => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:56.141285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.141937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.142397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.142674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.143511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:56.143818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:56.145520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a802bd-9676-4830-a1ed-93e0743a9722 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:56.146126 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b902-32ae-4935-945e-0f89fa71c012 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.146607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b902-32ae-4935-945e-0f89fa71c012 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.147093 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b902-32ae-4935-945e-0f89fa71c012 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.149563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 216/429] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:56.150803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b902-32ae-4935-945e-0f89fa71c012 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.160597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 214/430] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:55 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:56.160597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.160597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.160597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.198675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:56.203452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:56.339937 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.361129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 215/431] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:56.370526 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b902-32ae-4935-945e-0f89fa71c012 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.389421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.409281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.410579 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.411062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.413693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.415331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:56.417316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:56.419158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 217/432] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:56.427911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.479657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.523056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b086c57-4ec2-4e0e-8273-db8b7d646e07 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.561059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e1f1a-fc6e-477c-a623-9807b4a28e81 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.568775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.569854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.570338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.570849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.585394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:56.596638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:56.597507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:23:56.598286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:56.601261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 216/433] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:56.607321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.611287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.612033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.612370 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.612752 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.613755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:56.614183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:56.615655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24077d3f-5e54-48d1-b7e7-a70c27cb701f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:56.622704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=1c085d2a094c45ba95fd2ac7bec7294d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:56.670305 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c994d-795c-49e2-8a79-2874ba95b91c None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.670595 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c994d-795c-49e2-8a79-2874ba95b91c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.670937 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c994d-795c-49e2-8a79-2874ba95b91c None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.673028 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 219/435] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:56.681872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.682388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.682840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.707257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:56.708792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:56.723260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.746313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28391ae-9e42-4e11-a7cd-4980f4cdac45 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.795292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:56.806554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:56.810190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:56.813203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:56.813639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:56.814585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] RBAC: Adding query filter params (name=member) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:56.814897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:56.815609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 220/436] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:23:56.816393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:56.826340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 217/437] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:56.832483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.848978 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:56.970875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb66951-a4da-46a1-8282-48fe068d0034 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:56.982204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36e0de-3e50-48b7-8959-6bca7c31e155 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.015792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.017072 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.017553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.017996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.023961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.024788 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.025056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.025332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.034752 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.042195 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:57.051489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:57.052422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:57.053259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 218/438] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:23:57.060013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.116057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.118556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.126132 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.197224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a97567-9590-4156-af46-a76f0c0ddbb9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.234865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.235533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.235816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.236090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.236872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:57.237236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.238539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.244467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 221/439] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:23:57.245454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.251999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 219/440] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:57.257174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.293663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.345947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dfc5d-b551-455d-b3e4-a13a6ec0e57f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.354810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a2f9c-5038-4ced-ac5d-ffddf7eebf3e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.369023 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.377957 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.382581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.382581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.382581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.382581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.382581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41f91a-ba65-486b-8a64-e88ec5a14a8d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.383644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 222/441] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:57.384880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995d04-9177-445f-9c82-9504074d2ef4 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.385165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995d04-9177-445f-9c82-9504074d2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.385440 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3995d04-9177-445f-9c82-9504074d2ef4 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.386834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 223/442] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:23:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:23:57.389021 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995d04-9177-445f-9c82-9504074d2ef4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.392272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.392971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.393259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.393546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.460221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.461785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.487419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3995d04-9177-445f-9c82-9504074d2ef4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.501198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.521265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.522095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.522371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.522647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.523790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.525331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032c374-54e5-4dab-885c-79643cf52056 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.526921 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 224/443] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:57.529558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.529843 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.530123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.546396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:23:57.547560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:23:57.558101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 220/444] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:57.558932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.575159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.613795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 225/445] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:23:57.614619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.671703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8bb-eb5c-4f3b-b903-d9daa7d198ef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.704633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.705274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.705550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.705818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.706635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=f0fa45a74bbf41ba9d093d0b23ccc053, scope.project.id=2197aece67714272b454f81e99b5873d) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:57.706943 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.708362 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.712222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b0375-23ae-4460-b643-4ee5ae960f29 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.713941 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 221/446] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=f0fa45a74bbf41ba9d093d0b23ccc053 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:57.714698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.732714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.761038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.762055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.762825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.763209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] PATH_INFO: `/v3/projects/d834971bff2f4ef9b259002b3b3122c9` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.764688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] RBAC: Authorizing `identity:get_project(project_id=d834971bff2f4ef9b259002b3b3122c9)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.767063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.773723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 226/447] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/projects/d834971bff2f4ef9b259002b3b3122c9 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:57.774648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.802882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:57.826212 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fdbcc-c3e0-447a-bce0-4a1761beb4a5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.864743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.865816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.866100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.866719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.878651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:23:57.886771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:23:57.887645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:23:57.888463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 222/448] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:23:57.891271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ba3a8-1400-4728-bb08-b5360fa7f5bc None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:57.894977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:57.929025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:57.929837 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:57.930117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:57.930399 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] PATH_INFO: `/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:57.931595 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] RBAC: Authorizing `identity:get_group(group_id=5dbdfd8bf8b54d42bf82d3a6de7fb503)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:57.933078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:57.934697 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 227/449] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/groups/5dbdfd8bf8b54d42bf82d3a6de7fb503 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:57.941327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:58.001798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:58.018302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5adb-93e6-4067-83b5-a01ea5f3a3f3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.055443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.056212 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.056746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.057282 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.057781 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:58.058091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.059467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.064770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f3d-8c99-42d0-89b2-12ce6c01fa48 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.067157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:58.072448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 223/450] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:58.076645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:58.102112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.102765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.103045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.103317 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.104173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] RBAC: Adding query filter params (group.id=5dbdfd8bf8b54d42bf82d3a6de7fb503, role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=d834971bff2f4ef9b259002b3b3122c9) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:58.104509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.105930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.112987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 228/451] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:57 2022] GET /identity/v3/role_assignments?group.id=5dbdfd8bf8b54d42bf82d3a6de7fb503&scope.project.id=d834971bff2f4ef9b259002b3b3122c9&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:58.180772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490138e-ff1e-42b3-8f6b-793d58b66227 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.216396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.217083 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.217367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.217641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.286057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:58.288521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.289981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.384910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 224/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:23:58.390513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:58.485769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66133a-6198-42b9-8fb4-8e4daa9e17ce None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.495630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:58.517358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.518191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.518465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.518731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] PATH_INFO: `/v3/projects/2197aece67714272b454f81e99b5873d` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.519927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] RBAC: Authorizing `identity:get_project(project_id=2197aece67714272b454f81e99b5873d)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.521486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.523116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 229/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:23:58 2022] GET /identity/v3/projects/2197aece67714272b454f81e99b5873d => generated 302 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:23:58.528374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:58.621503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:23:58.624303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbcc54-9d86-4999-92b7-1c93339e7a89 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.657379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.658211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.658492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.658765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] PATH_INFO: `/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.659910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] RBAC: Authorizing `identity:get_group(group_id=df9cb85ef2294b52ad2118ec3ebcdbd9)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.661375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcf381-8547-4926-99e2-92450c49c46c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.662951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 225/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:23:58 2022] GET /identity/v3/groups/df9cb85ef2294b52ad2118ec3ebcdbd9 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:23:58.668585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:23:58.763230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42458fc-e2e7-4a98-ab42-06a036b98576 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:23:58.795795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:23:58.796436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:23:58.796724 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:23:58.796994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:23:58.797832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] RBAC: Adding query filter params (group.id=df9cb85ef2294b52ad2118ec3ebcdbd9, role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=2197aece67714272b454f81e99b5873d) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:23:58.798134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:23:58.799610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32640e90-c184-41b6-ba1d-42ea1e62053e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:23:58.805315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 230/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:23:58 2022] GET /identity/v3/role_assignments?group.id=df9cb85ef2294b52ad2118ec3ebcdbd9&scope.project.id=2197aece67714272b454f81e99b5873d&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:01.598339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef5c-2c48-4140-a93b-8feef1869b78 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.599053 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff07-dd73-453c-aa67-f993a504a29f None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.599511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef5c-2c48-4140-a93b-8feef1869b78 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.599675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff07-dd73-453c-aa67-f993a504a29f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.599821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5ef5c-2c48-4140-a93b-8feef1869b78 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.599963 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdff07-dd73-453c-aa67-f993a504a29f None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.601491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 226/457] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:01.601677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 231/457] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:01.605376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2001382-d762-4686-ad73-d9f939160292 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.605670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2001382-d762-4686-ad73-d9f939160292 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.605956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2001382-d762-4686-ad73-d9f939160292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.608581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.608870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.609145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.639422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d2001382-d762-4686-ad73-d9f939160292 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:01.641407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:01.642595 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:01.645463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d2001382-d762-4686-ad73-d9f939160292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:01.700060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:01.734941 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 232/458] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:01.770076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:01.773838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:01.798886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2001382-d762-4686-ad73-d9f939160292 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:01.911299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269547c1-f3da-439d-a12b-68d78618c0e6 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:01.926269 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:01.930664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2001382-d762-4686-ad73-d9f939160292 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:01.952179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:01.954019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.954370 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.954993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.968315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:01.968806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:01.969591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.969868 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.970076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:01.970174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:01.984981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:01.986406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-85dc9414-90c7-48fb-8204-f1cad9979414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:01.993410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:01.994238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:01.995393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:01.995393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:01.995393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:01.995393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:01.995393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 233/460] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:01.997177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274575-501a-4d39-9359-45ae2e53ea6c None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:01.999618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274575-501a-4d39-9359-45ae2e53ea6c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:01.999618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274575-501a-4d39-9359-45ae2e53ea6c None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.000172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 234/461] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:02.000828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98274575-501a-4d39-9359-45ae2e53ea6c None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-51d85fe6-0460-4117-a2a5-8f63d011bdd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:02.011114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:02.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:02.012887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:02.012887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:02.012887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.012887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:02.013606 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 228/462] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:02.015600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d383-eb7a-4ace-8991-425ca239ed5a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.015892 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d383-eb7a-4ace-8991-425ca239ed5a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.016165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d383-eb7a-4ace-8991-425ca239ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.032293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f0c9d383-eb7a-4ace-8991-425ca239ed5a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:02.032881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.033488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f0c9d383-eb7a-4ace-8991-425ca239ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 229/463] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ad50-b937-41c2-b1a6-7e0f8584c013 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ad50-b937-41c2-b1a6-7e0f8584c013 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8ad50-b937-41c2-b1a6-7e0f8584c013 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 230/464] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:02.107437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ad50-b937-41c2-b1a6-7e0f8584c013 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.118921 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98274575-501a-4d39-9359-45ae2e53ea6c None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.156949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.157691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.157973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.158247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.158962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:02.159389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.160908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dcf11-f8e7-4c96-87e5-aea4b9047b90 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.184079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 235/465] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:02.185402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.185693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.185973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.203998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:02.205204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:02.208923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.229013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8ad50-b937-41c2-b1a6-7e0f8584c013 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.266262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.267025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.267302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.267571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.268282 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:02.268612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.270205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.277765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 236/466] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:02.278609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.290107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 231/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:02.291244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.293536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.384462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dff00-94b4-4eed-9466-b96f8677e393 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.398203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4dc60-5819-47b7-aba8-b3453c95d977 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.418299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.419111 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.419400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.419658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.430441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.431900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.439802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.441243 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.441673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.442574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.443699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.445331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:02.451255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:02.452116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:02.452995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:02.452995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:02.452995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.452995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:02.452995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 237/468] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:02.453733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.459298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.518262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.532449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 232/469] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:02.532449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.572732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a05d-1c4e-454a-befe-db2ffaf0db12 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.629184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.630358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.630906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.631187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.631900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.653078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c66c-60a2-4bc8-8f5e-0ca3e90b3dae None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.691333 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.692059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.692344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.692654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.705016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.706480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.711163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 238/470] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/users => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:02.712225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:02.727402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:02.728315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:02.729179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:02.729179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:02.729179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:02.729179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:02.729179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 233/471] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:02.735498 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.805510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.849406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51738-707b-446e-ac34-e91f8b8ee0d0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.873633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70891-1f53-443b-b2b8-9ca128c41507 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:02.881732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:02.894790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.895472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.895753 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.896255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.897846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:02.899144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.900109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bc8ed-9cbc-4b57-928a-bf08caf760ca None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.914946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 239/472] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:02.916436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8fe1-fecc-4a81-8bc5-4a39629be963 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.916436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8fe1-fecc-4a81-8bc5-4a39629be963 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.920650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d8fe1-fecc-4a81-8bc5-4a39629be963 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.922159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:02.922829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.923119 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.923327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 240/473] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:02.923427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.924072 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8fe1-fecc-4a81-8bc5-4a39629be963 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:02.924178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:02.924477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:02.926693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7343a3-a6aa-48cb-b863-527ac7cbb503 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:02.941949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 234/474] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:02.943316 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:02.943602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:02.943946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:02.965663 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:02.966862 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:03.045197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d8fe1-fecc-4a81-8bc5-4a39629be963 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:03.060189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 235/475] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:03.061125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:03.110039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:03.110971 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:03.111257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:03.111561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:03.112941 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:03.114872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:03.122671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:03.188436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba60008-27b6-4f64-a264-209ce530ec50 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:03.225690 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:03.226361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:03.226646 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:03.226927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:03.227622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:03.229105 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:03.252505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 241/476] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:02 2022] POST /identity/v3/users => generated 248 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:03.253315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:03.305802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:03.325225 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 236/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:03 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:03.388680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccc9fd-3685-4e0c-a055-a857c4fb6f49 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:03.435334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:03.436027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:03.436845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:03.437152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:03.437905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:03.439319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:03.480610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.sql.core [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:24:03.480610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 22:24:03.480610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [parameters: {'id': 'e6e367a3d0064c8b81f3636b86ccf069', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 22:24:03.480610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80047) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:03.498198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:03.499665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application yield resource Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise self.value Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application session.commit() Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:24:03.500657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:24:03.501521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:03.502390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:03.503280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [parameters: {'id': 'e6e367a3d0064c8b81f3636b86ccf069', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:03.504043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 22:24:03.504871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:03.505707 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 242/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:24:03 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:03.507099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:03.619260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:03.627054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d5227-1cc5-4642-9c8f-eabde663fe5e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:03.663769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:03.664662 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:03.664948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:03.665226 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:03.675650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c40144f0-322f-4738-b5c2-4da9aad0991b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:03.683966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:03.684932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:03.685721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 237/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:03.691626 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:03.804495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63dd885-9a92-4502-a3cb-0a4315277a9a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:03.806025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:03.900869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:03.901589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:03.901870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:03.902147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:03.902946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:03.903255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:03.904655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd828c-90ce-4c0f-9cd3-a7f0d0b5d1fb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:03.915887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 243/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:04.986995 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885be43-5937-4777-8ad6-1e4638a577c6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:04.987692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885be43-5937-4777-8ad6-1e4638a577c6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:04.987692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885be43-5937-4777-8ad6-1e4638a577c6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:04.989168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 238/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:04.995069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5577d-105e-431e-85af-60996d67beb1 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:04.995492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5577d-105e-431e-85af-60996d67beb1 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:04.995625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5577d-105e-431e-85af-60996d67beb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.021376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-ecf5577d-105e-431e-85af-60996d67beb1 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:05.022815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ecf5577d-105e-431e-85af-60996d67beb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:05.112267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 244/482] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:05.144853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885be43-5937-4777-8ad6-1e4638a577c6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.291030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4802-deec-43d4-9448-b64d2dde31a1 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.291740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4802-deec-43d4-9448-b64d2dde31a1 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.292223 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4802-deec-43d4-9448-b64d2dde31a1 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.294087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 245/483] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:05.306318 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885be43-5937-4777-8ad6-1e4638a577c6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:05.307495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.307982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.308483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.342324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:05.344529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:05.344637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:05.345388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.345677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.345952 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.357507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:05.366613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:05.367522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:05.368325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 239/484] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:05.374482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.395859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:05.486923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 246/485] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:05.524072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e35bd-cd54-4094-9893-c1690a2476d2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:05.543355 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.573890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:05.576914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:05.578403 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.578899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.579545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.580832 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:05.581658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:05.583478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:05.604822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 240/486] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:05.607069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.730494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04e3db-dcab-4eec-bc1d-0581f7311181 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:05.742996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:05.764457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e30c8-5292-4b12-a066-9c15c1351ad2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:05.779665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:05.781297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.781578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.782198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.797796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:05.801128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:05.801989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.802342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.802729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-d8174fdd-985d-4874-99e2-c51b30904767 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:05.806771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:05.807656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:05.808598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 247/487] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:05.810429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69603-073e-4ebf-86a4-4fab0ecf0a97 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.810429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69603-073e-4ebf-86a4-4fab0ecf0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.813129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f69603-073e-4ebf-86a4-4fab0ecf0a97 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.813129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 248/488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:05.817331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f69603-073e-4ebf-86a4-4fab0ecf0a97 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.818242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:05.819874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ce927b01-915c-4bca-99f0-0525e12ffe78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:05.838327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:05.840018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:05.842072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:05.842072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:05.842072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:05.842072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:05.842072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 241/489] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:05.843309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.843309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.843309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.869977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:05.871284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:05.920059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:05.942331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f69603-073e-4ebf-86a4-4fab0ecf0a97 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:05.972775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 242/490] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:05.973908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:05.988955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:05.989623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:05.989909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:05.990188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:05.990940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:05.991249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:05.993463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08000c7a-8a87-406c-ae3e-914cf30db874 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.002501 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 249/491] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.003831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dacab-f08d-4e99-be9c-e3e763fc2fb2 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.004121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dacab-f08d-4e99-be9c-e3e763fc2fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.004413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dacab-f08d-4e99-be9c-e3e763fc2fb2 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.005641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 250/492] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:06.009383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dacab-f08d-4e99-be9c-e3e763fc2fb2 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.053479 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.096592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc6a13-5526-404b-bb80-c9b3a39e23dc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.120865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dacab-f08d-4e99-be9c-e3e763fc2fb2 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.131252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.131915 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.132199 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.132510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.133244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:06.133522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.135167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeb9a2-3ffe-4709-8750-cf138659f141 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.147209 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 243/493] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.148235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.148558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.148836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.162059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.162857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.163142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.163442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.166315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:06.167494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:06.175217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.176715 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.195282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:06.196776 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:06.197629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:06.198452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:06.198452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:06.198452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:06.198452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:06.205824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 251/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:06.205824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.251270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 244/495] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:06.252039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.307231 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.327616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f812b64-5419-4092-ab27-6c794111f3b5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.361725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310e113-c799-43f2-acf8-0fb132ac4012 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.362128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.362919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.363203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.363484 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.374480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:06.382218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:06.383095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:06.383870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 252/496] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:06.384569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.404139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.405813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.406260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.406717 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.414582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.416350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:06.432713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:06.433589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:06.434452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:06.437323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 245/497] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:06.438224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.447985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.492145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b054a-2685-49d5-b625-fb98feea78d5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.529129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.529789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.530172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.530450 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.531161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:06.531465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.532864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.544289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 253/498] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.545104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.553401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13465a-c48a-485a-b9bd-39538db64fb5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.564718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.589999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.590779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.591059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.593727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.601365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:06.609111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:06.610166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:06.611057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 246/499] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:06.611722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.655140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9644c7-c7f4-4bf8-9c5a-dd02d8a34df6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.671811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.688524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.689190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.689474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.689751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.690516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:06.690827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.692234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.700856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 254/500] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.701903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.709812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef42a0-0a4c-46a0-be88-c3eb190bdbad None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.741719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.742371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.742655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.742926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.743745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:06.744048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.745506 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44e031-c548-4879-80fc-7f2bef685fca None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.781482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 247/501] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.782759 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e32-7e56-4960-b5da-b6cfd47dac22 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.783039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e32-7e56-4960-b5da-b6cfd47dac22 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.783312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02242e32-7e56-4960-b5da-b6cfd47dac22 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.784543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 248/502] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:06.785215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242e32-7e56-4960-b5da-b6cfd47dac22 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.806384 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98942fa-8b53-4baa-a166-66dabb8c1d5f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.812790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.839205 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.839678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.839957 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.840228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.847467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.848952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:06.864633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:06.865533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:06.866684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 255/503] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:06.867244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.889446 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02242e32-7e56-4960-b5da-b6cfd47dac22 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:06.910720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:06.924335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:06.926338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:06.926338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:06.926338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:06.926338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:06.926642 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:06.927959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:06.935886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 249/504] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:06.937310 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:06.967447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175140e-c378-4c6c-bfba-2104b644f099 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.001344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.002126 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.002410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.002687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.013128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.014617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.020992 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-fc95e834-ebfd-4bfd-b6f6-9b8361613fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:07.031763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:07.033903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:07.035263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:07.035263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:07.035263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.035263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:07.035534 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fd4b4-6684-4509-a9bb-c7440cc1593d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.035616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 256/505] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:07.035616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.035616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.035616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.050768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:07.051951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:07.072275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.072967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.073247 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.073523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.118780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 257/506] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:07.119539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.140718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.142160 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.146656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.225055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b7ee9-3581-4eac-8608-70de9cad6351 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.228623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.241951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 250/507] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:07.242754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.263297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.263969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.264277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.264590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.265424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:07.265732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.267165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.302476 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 258/508] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:07.303273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.347168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2b00b-f4ad-448e-9823-66920a063b83 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.380272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.381004 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.381283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.381556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.382660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.391772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.393245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.401680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a9af7-609e-44fa-9800-6dff8cedf7df None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:07.410033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:07.410890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:07.411746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:07.411746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:07.411746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.411746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:07.411746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 251/509] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:07.412013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.441229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.441913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.442201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.442477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.443189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:07.443491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.444914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.456172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.456666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 259/510] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:07.457657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.515356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f85157-a4b1-48cb-98ee-899e24132327 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.547398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.548170 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.548477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.548755 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.555095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d5953-a2c5-4360-9ccf-7cc76765c9bc None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.558888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.560306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:07.577730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:07.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 252/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:07.579626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.590012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.590794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.591075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.591347 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.600235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.602336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.603785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:07.620983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:07.622011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:07.622846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:07.622846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:07.622846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:07.622846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:07.623287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 260/512] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:07.624868 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.674075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.682221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293cef2-3c1c-4926-b44b-01af6941695c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.714996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.715630 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.715914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.716186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.723464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2a5ab-8060-49cc-a8e2-310b061506e4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.756955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.757605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.757886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.758160 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.758866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:07.760040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.760548 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.771978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 261/513] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:07.772792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.782704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.788871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.825746 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.871992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f7066-d157-4e13-aeca-19b76a8b1e02 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:07.872524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:07.881954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 253/514] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:07.882752 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.907182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:07.907977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:07.908279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:07.908585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:07.915444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:07.916940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:07.931593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:07.932564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:07.938147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:07.978490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393723aa-93bd-46fa-8177-d5b81f4a9155 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.011526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.012176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.012485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.012765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.013546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.013853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.015205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.025954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 254/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.026732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.034332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d1df7-34da-479d-b3fe-242b0b352565 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.047471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.068269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.069210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.069535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.069993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.070755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.071345 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.072757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.079924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.084798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.085584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.126645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973756a-d58a-469c-a305-0fd1773ba52e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.159054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.159855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.160135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.160435 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.167735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.169312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:08.183202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:08.184096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:08.185481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.190944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91370695-1a62-4ec8-8bd6-f776e58582ef None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.225080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.225877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.226163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.226445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.237418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.238864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:08.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:08.257006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:08.257907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:08.257907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:08.257907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:08.257907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:08.257907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 264/519] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:08.258167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.282782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.284085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8959ef-9ffc-42ec-ad08-12b9754ec8df None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.297091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.317835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.318503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.318786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.319060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.319888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.320192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.321669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.338743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 256/520] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.338743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.354757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01f0c4-41d2-403b-9e14-42a757480549 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.397011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.397654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.397933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.398204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.398887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.400388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.439148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0e0d-bc7e-4299-8d5b-aab0ab8baee2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.456494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 265/521] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:08 2022] POST /identity/v3/users => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:08.457220 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.483603 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.485006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.485321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.485718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.496305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.497842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:08.516311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:08.517295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:08.518202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 257/522] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:08.519460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.552756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.553767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.575731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca426f-86c4-4599-b072-af64e9bd7d53 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.613337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.614006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.614293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.614569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.615398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.615706 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.617427 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.635066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617186f-1d08-474a-b6b5-9bf31298d71f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.635973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 266/523] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.636760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.673669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.674339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.674622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.674895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.675615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.675918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.677345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.690770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 258/524] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.692541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.747169 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca64ed-1507-46e4-b305-3c012ed49bcf None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.787685 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.789041 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.789817 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.790226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.790505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.798098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464cce5-1c40-4836-b144-d258e0060f13 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:08.802183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:08.835416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:08.836069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:08.836412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:08.836708 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:08.837485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:08.837956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.839402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.858704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 259/525] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:08.858704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.871028 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:08.872659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:08.974845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 267/526] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:08.975435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:08.979748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc59da6-3f20-40b4-af7d-b4f534b6e1f6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.015833 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.019379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.020306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.020614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.020890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.046568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.075039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ad516-4703-4b10-b95f-9ebae704a00f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.106000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.107979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.109493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.110279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.110559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.110830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.119180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.120666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:09.135506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:09.136561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:09.137644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:09.141666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 268/527] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:09.142707 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.224173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 260/528] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:09.225235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.251827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.256444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01c06f-11a6-4182-886a-c57782645166 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.275847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.293575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=65b5d79ac93d475ab781370bd3ca4877) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.300191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.308745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/role_assignments?user.id=65b5d79ac93d475ab781370bd3ca4877&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:09.309628 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.335279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839883e-67ae-4c24-953f-a585938c2853 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.385546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.387024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.387540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.388725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.403448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.406002 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:09.425635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:09.426576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:09.427423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:09.427423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:09.427423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:09.427423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:09.427641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0c73-6bd1-46ac-b78f-80aa1c819368 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.434309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 261/530] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:09.435673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.466994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.467761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.468048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.468319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.469150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:09.469459 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.470965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.489161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:09.489933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.519045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.565452 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970d137-2b84-4cd0-a32e-7bad08fd1cc7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.567572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.603459 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49757e7-5f33-46f6-bb96-79726f9ea03b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.617172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.617968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.618250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.618523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.634518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.636348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.646124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.646793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.647082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.647356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.648078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:09.648385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.649793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:09.658268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:09.659104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:09.659971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:09.659971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:09.659971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:09.659971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:09.665901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:09.665901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.666122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 262/533] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:09.669633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.758381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.772845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c02ff6-d5dc-4a87-808d-94c4901fcab1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.779590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954357a1-6e38-4a2a-a670-ecb660bcb300 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.807879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.808600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.808976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.809163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.809997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:09.810704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.812675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.819802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 272/534] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:09.820487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.820819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.821751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.822236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.822652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.831224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.833302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:09.849884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:09.851046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:09.851900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:09.854614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 263/535] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:09.861394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:09.880786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:09.932712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f83b8-002e-4c62-863c-c381419680aa None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.969076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:09.969796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:09.970019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:09.970294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:09.971047 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:09.971558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:09.972768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:09.978058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630370-ddcf-4b1f-bf6a-4fe2369fa303 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:09.985749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 273/536] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:09.991542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:10.003546 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:10.019147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.020201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.020712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.021214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.022288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:10.022769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:10.024385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:10.037586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 264/537] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:10.043956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:10.100619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918a22f-8e6c-453b-a89c-04a9ca106403 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:10.136769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:10.137304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.137756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.138039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.138314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.145762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:10.147217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:10.157768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2779e2-85d2-4c3f-a528-4e206e15e586 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:10.163040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:10.163896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:10.165171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:10.168764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 274/538] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:10.170139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:10.203368 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.204430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.204910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.205454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.206623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ec4e612bcb464df28bcf900197a64449) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:10.207149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:10.208910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:10.215402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 265/539] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:10 2022] GET /identity/v3/role_assignments?user.id=ec4e612bcb464df28bcf900197a64449&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:10.292991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:10.351471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035bd7-0b61-4708-a108-16556161d1a9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:10.392593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.393264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.393546 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.393823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.394608 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:10.394916 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:10.396365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70558ea-509d-41ff-ae1c-49d74cfe5e9b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:10.409970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:10.415733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:10.530400 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a233c1b-d4ac-4d94-a666-68100a535847 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:10.560733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c3e0-8e24-4ccc-bad9-6b79426686d6 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.561052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c3e0-8e24-4ccc-bad9-6b79426686d6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.561264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5c3e0-8e24-4ccc-bad9-6b79426686d6 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.562887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 276/541] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:10.567831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.568122 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.568426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.574890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.575807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.576281 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.577439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.578454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=79e38a947d4a42f68cb6457ae2101234) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:10.578958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:10.580596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:10.587077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 266/542] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:10 2022] GET /identity/v3/role_assignments?user.id=79e38a947d4a42f68cb6457ae2101234&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:10.613710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:10.614973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:10.710227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 277/543] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:10.742649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:10.751216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:10.871643 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3299f-640d-41e3-8607-0f1b10b4debe None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:10.911897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:10.912724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:10.913010 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:10.913285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:10.929464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:10.937756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:10.938620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:10.939415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:10.943518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 267/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:10.947867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.032770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:11.074283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e10eb-712b-4c42-b920-1db6cdcf293f None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:11.109236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:11.110064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.110463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.110828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.111667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:11.112067 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:11.113622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:11.122626 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 278/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:11.128468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.211620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:11.258847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c1b9a-0f18-40bb-bc1c-7dce1da0c44d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:11.306155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:11.306944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.307223 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.307496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.326306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:11.327787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:11.351288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:11.352176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:11.353135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:11.353135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:11.353135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:11.353135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:11.353135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 268/546] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:11.358875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.460842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d99e4-b364-4bf2-a868-f8b29b4cbc08 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:11.477887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:11.495117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:11.495783 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.496060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.496329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.497069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:11.497427 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:11.499537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:11.511934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 279/547] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:11.517442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.643707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b900-a584-41f9-85bf-51f209994c8a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:11.663306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:11.691008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:11.691798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.692124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.692423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.709214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:11.710679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-16ec9a92-83c2-4d12-bab3-8d4e93f25bda None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:11.728360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:11.729458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:11.730361 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:11.735919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.832088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23964-fe4e-4af1-9e15-29212cfc3f83 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.832443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23964-fe4e-4af1-9e15-29212cfc3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.832659 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23964-fe4e-4af1-9e15-29212cfc3f83 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.834640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 270/549] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:11.840181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.840489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.840767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.861593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0727f13b-e186-43c7-8305-968244a7c354 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:11.873900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:11.875100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:11.897848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:11.898599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:11.898953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:11.899300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:11.900247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:11.900663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:11.902204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:11.928870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 280/550] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:11.937324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:11.996844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.016928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 271/551] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:24:12.069993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.080885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b61c38-6651-4914-ad69-ddd65a6d56ac None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.140011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.140707 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.140960 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.141237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.256855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8cf0f7-540d-4f06-b759-fe73b1921a2a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.267750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.270592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:12.272169 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:12.296919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.297716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.297999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.298271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.316088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:12.329535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:12.330484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:12.331297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:12.337425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.338469 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.458736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4c89-409c-4dbb-9bf5-e71bc7c6694f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.468840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 281/553] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:12.474382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.494973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.495746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.496034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.496312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.497109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:12.497412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:12.498828 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:12.507730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 273/554] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:12.513304 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.597145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.672472 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38bbb8-e9e3-4c65-9ae1-72350d76c81d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.706688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d864bc-eb9a-4219-947f-e6f044650e81 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.712425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.712425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.712425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.712425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.721812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:12.723482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-1b0c7891-9336-4880-96a2-e9d8a974c9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:12.742640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:12.743711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:12.744604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:12.744604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:12.744604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:12.744604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:12.748826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 274/555] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:12.750640 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5caf-8ee4-4dcc-9d50-05fec8348af5 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.751128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5caf-8ee4-4dcc-9d50-05fec8348af5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.751706 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc5caf-8ee4-4dcc-9d50-05fec8348af5 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.753537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 275/556] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:12.754971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc5caf-8ee4-4dcc-9d50-05fec8348af5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.756757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.757991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.758228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.758504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.762737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.773195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:12.774927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5073a7ef-14e8-4ed8-b0a2-d22d9a016aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:12.793085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:12.794002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:12.795920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:12.795920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:12.795920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:12.795920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:12.795920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 282/557] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:12.796202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19451f00-0a3a-4916-b37d-7beb0769a94f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.796868 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19451f00-0a3a-4916-b37d-7beb0769a94f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.796868 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19451f00-0a3a-4916-b37d-7beb0769a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.814055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-19451f00-0a3a-4916-b37d-7beb0769a94f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:12.815211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-19451f00-0a3a-4916-b37d-7beb0769a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:12.850707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:12.875837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc5caf-8ee4-4dcc-9d50-05fec8348af5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:12.881190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 283/558] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:12.882497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65571f9-a9d3-48c2-8368-545bda2ed4bc None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65571f9-a9d3-48c2-8368-545bda2ed4bc None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.883048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65571f9-a9d3-48c2-8368-545bda2ed4bc None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.884430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 284/559] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:12.892668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65571f9-a9d3-48c2-8368-545bda2ed4bc None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:12.919657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:12.920848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.921131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.921401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.922109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:12.922409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:12.923777 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d879c7-5920-42d9-bde9-a104e3c61a0f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:12.941045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 276/560] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:12.941045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:12.941045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:12.941045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:12.955223 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:12.956391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:13.000325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65571f9-a9d3-48c2-8368-545bda2ed4bc None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.017771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.024096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 277/561] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:13.025188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.043649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.044362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.044676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.045003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.046306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:13.046611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.048150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.060015 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 285/562] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:13.061497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.107369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.140744 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b30c1a-5864-484b-9ec0-ab74c150f414 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.161559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edbca2-ebad-4b7c-b158-3e05d14a1817 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.174442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.175229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.175509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.175779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.185808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:13.193415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.194340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:13.195182 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 278/563] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.195965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.201388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.202186 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.202466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.202743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.211164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.212643 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:13.227447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.228588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 286/564] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.229700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.269151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.300569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c6697-c28a-42a6-93b6-cafc58421dc9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.326582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.330915 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ee1ba-95f8-4d03-93e4-3c717fd56f0b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.334075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.334859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.335144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.335419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.346570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3682c366-8c54-4287-8606-7d041d8ab01f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:13.354280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.355402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:13.356297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 279/565] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.357040 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535993-0d8a-41aa-a61b-a17598ba516f None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.357040 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535993-0d8a-41aa-a61b-a17598ba516f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.357269 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67535993-0d8a-41aa-a61b-a17598ba516f None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.360454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 280/566] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:13.360454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535993-0d8a-41aa-a61b-a17598ba516f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.371705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.372517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.372804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.373076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.379678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.381142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:13.394376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.395277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:13.396158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 287/567] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.396668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.461200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67535993-0d8a-41aa-a61b-a17598ba516f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.493774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.496016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.496702 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.496987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.497263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.497526 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a639ebe-605d-4eac-9150-ef14d301e1f8 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.498036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:13.498369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.499750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.507797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 281/568] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:13.508611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.532739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.533331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.533619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.533883 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.534696 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:13.534997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.536442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb158767-c7da-4d57-8197-e3ba8c43e2ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.553437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 288/569] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:13.554625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.554909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.555188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.560338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.570916 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:13.572215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:13.607321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb96eaf9-e6e4-4aff-879f-c47a38e0ff01 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.638140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 289/570] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:13.639605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.657573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.658245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.658529 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.658801 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.659545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:13.659851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.661341 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.669629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 282/571] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:13.670437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.721488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.735850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd95968-2ec1-47e4-b222-5c2e6e982b3f None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.769790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.770075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404df55-2fbe-4485-8688-0655ab6cd75b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.770442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.770723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.770996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.771832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:13.772137 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.773613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.783598 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.785512 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 290/572] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:13.786291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.808502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.809283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.809565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.809840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.821021 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.822475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:13.839346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.840518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.841425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:13.841425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:13.841425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:13.841425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:13.841425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 283/573] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.841700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.890413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22451d-b931-4824-98fa-efbde84416c6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.923869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.924698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.924977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.925249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.935379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:13.937354 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:13.939284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c1907-eec2-4e1e-9f4d-e74b16232bbd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:13.943441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:13.954782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:13.958555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 291/574] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:13.959635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:13.973500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:13.974287 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:13.974567 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:13.974837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:13.984814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:13.992705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:13.993807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 284/575] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.000187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.022095 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.055778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed583cb-748b-48aa-9047-d990506b54ac None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.089242 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.090026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.090341 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.090620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.093903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837a39f-a9cc-4f73-a3c8-cc4386a9b8a0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.101212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.102660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:14.119529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.121474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:14.121474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:14.121474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:14.121474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:14.121927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 292/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.122842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.129009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.129658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.129939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.130215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.131034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=5a6b2fb527f041f7ba3c2447b824141c) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.131345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.132774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.138122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 285/577] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:13 2022] GET /identity/v3/role_assignments?user.id=5a6b2fb527f041f7ba3c2447b824141c&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.139462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.176069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.242049 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.242827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e771dc-0875-437b-819d-a76bbe675689 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.254831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eddf38-3965-4a04-8199-e192d8cf1024 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.281744 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.282409 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.282691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.282965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.283682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.283985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.285392 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.290909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.291569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.291850 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.292120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.292865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.293934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.295817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.299122 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 293/578] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.299932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.309238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 286/579] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.309846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.413235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3b82-708b-4d54-9c8b-5be78207cdcf None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.413438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e5003-6988-4508-843b-db2757b9e154 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.425075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.448367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.449068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.449406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.449686 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.450424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.450729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.451292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.451947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.452133 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.452229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.452519 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.453235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.453540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.454877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.461596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 294/580] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.465627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.467245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 287/581] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.468135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.479421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.573385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b35fd0-6ba1-4f56-ab26-985486b9c7c5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.585467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53236e3-9fc0-4542-8dad-fbc95be7abf3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.612508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.613312 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.613601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.613876 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.622123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.623948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.624124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.625209 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.625650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.626060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.633042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.634618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:14.638286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.639397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:14.640563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:14.644288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 295/582] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.645030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:14.652510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.653540 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:14.655145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:14.657246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 288/583] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.658146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.685624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.728517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.760962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e518a6-7457-4d27-96ae-2ba55eda588b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.764155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5020-ca74-4684-be30-7f8be55e3566 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.794784 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249276-7060-43ee-b08b-49420acf228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.796166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249276-7060-43ee-b08b-49420acf228c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.796465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249276-7060-43ee-b08b-49420acf228c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.796738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35249276-7060-43ee-b08b-49420acf228c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.807280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249276-7060-43ee-b08b-49420acf228c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.807729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.808829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35249276-7060-43ee-b08b-49420acf228c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.809014 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.809545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.809821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.818532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.820032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-35249276-7060-43ee-b08b-49420acf228c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:14.827522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.828396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.829553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:14.829553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:14.829553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:14.829553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:14.833422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 296/584] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.834038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249276-7060-43ee-b08b-49420acf228c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:14.835122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:14.836042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:14.836996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 289/585] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:14.838406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:14.929642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.944035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35249276-7060-43ee-b08b-49420acf228c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.944716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8335cb-e6e0-4a66-9544-7d85f1f288eb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:14.973496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:14.981659 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.981788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:14.982318 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.982433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:14.983145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.983245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:14.983426 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.983521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:14.984203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.984308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:14.984545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.984640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:14.985962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.986058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:14.997732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 290/586] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:14.997732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.006560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 297/587] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.008520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.107161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc305e6-0bba-46ab-b17d-bfb0f0207360 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.114050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534187-0dd4-4d8e-9404-0affdee58f5e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.142395 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.143056 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.143339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.143615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.144457 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:15.144768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.146189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.148838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.149491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.149773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.150044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.150748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:15.151051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.152380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.161935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.168799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 291/588] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.168799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.169008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 298/589] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.169008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.227488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.280967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f356b3b-c5be-4e3e-9ab1-57ffa5839230 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.281814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf988c8-615f-4aa6-a67c-3796d4941421 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.316587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.317375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.317656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.317956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.322989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.323872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.324147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.324436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/65b5d79ac93d475ab781370bd3ca4877/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.329230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.330691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.340476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=65b5d79ac93d475ab781370bd3ca4877, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.341916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:15.350855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:15.356307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 299/590] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:15.357306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.406427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 292/591] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:15 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/65b5d79ac93d475ab781370bd3ca4877/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:15.407190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.411727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.482411 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f87a8-6094-49f8-9237-fc4f4b43507d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.522904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.527087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc4cb3-e31c-4cd6-bc5b-aae0cfc7b394 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.538895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.540600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.541066 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.541495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.553228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.555559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.566030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.566825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.567132 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.573686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:15.575798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:15.577283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:15.578255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:15.580362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 300/592] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:15.581287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.582173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.583783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:15.605617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:15.606589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:15.607597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:15.607597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:15.607597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:15.607597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:15.607597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 293/593] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:15.607904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.695009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e17632-3f76-4d7d-8af8-6b40f1bf2c93 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.717031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.733179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa944e9f-fbf8-45d1-a022-c81e154e187d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.745533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.746725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.747161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.747587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.749704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:15.750167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.752280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.770031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 301/594] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.771147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.776759 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.777472 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.777756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.778030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.778875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:15.779180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.780792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.800698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 294/595] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.801546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.819625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:15.908115 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f242cb-50ea-441f-8fc6-8417b7ca4c15 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.930285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8170280-41d5-46f6-a871-7da68c94cf5a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:15.950338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.950929 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.951241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.951518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.952244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:15.952603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.954225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:15.971900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 302/596] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:15.971900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:15.979481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:15.980439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:15.980792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:15.981151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:15.990089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:15.992087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.004231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:16.007569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:16.008738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.009910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:16.011941 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 295/597] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:16.012936 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.093460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.098165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d29cf-a374-49a1-9aba-77334c215fe3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.129355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5a95a-3908-40b9-830e-6d57ada478ee None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.134556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.135424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.135771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.136110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.147085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.148653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:16.167249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:16.168482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:16.169585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:16.169585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:16.169585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:16.169585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:16.169855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.171207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 303/598] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:16.171545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.172038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.172246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.172645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.180917 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.182671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:16.206434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:16.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:16.212570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 296/599] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:16.213603 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.272493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35300b56-566f-41aa-a4b5-38df90a4f398 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.305911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.306636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.306841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.307120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.307895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:16.308199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.309654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6375b-f294-42a3-964b-16681093a4d8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.318661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97a469-58b4-41e1-8e44-57f75ad3c8cd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.321357 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 304/600] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:16.322646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8ed6-cb6c-47f7-a406-32b88c4e7d92 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.322936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8ed6-cb6c-47f7-a406-32b88c4e7d92 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.323214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d8ed6-cb6c-47f7-a406-32b88c4e7d92 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.329985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 305/601] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:16.329985 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8ed6-cb6c-47f7-a406-32b88c4e7d92 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.356535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.357190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.357528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.358490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.359240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:16.359536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.360978 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.376679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 297/602] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:16.376679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.395517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.426429 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.439430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d8ed6-cb6c-47f7-a406-32b88c4e7d92 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.475154 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.475809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.476092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.476372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.477193 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:16.477529 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.479020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed6d9-ef4d-47f3-8f7f-650caea71f07 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.479748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a7558-1418-4727-857e-38db6a4dbc75 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.491878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 306/603] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:16.493123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.493409 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.493689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.499178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.512651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:16.514839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:16.521857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.522743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.523025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.523295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ec4e612bcb464df28bcf900197a64449/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.538455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=ec4e612bcb464df28bcf900197a64449, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.539881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.587243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 307/604] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:16.588077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.611754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 298/605] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:16 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ec4e612bcb464df28bcf900197a64449/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:16.618634 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.674906 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.715303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823219-4d87-48c1-a06d-b82b250154ea None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.748562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eff64a-0c73-4c43-9b1a-6d4b1210c785 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.760589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.761480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.761830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.763279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.765485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:16.772438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.773952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:16.794894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:16.795825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:16.796789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:16.798403 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.799527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.799975 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.800442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.800557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 308/606] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:16.801500 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.817119 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=d620bd7c93f640ef8ec03ea691926996, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:16.819653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:16.909449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c34ca-c9d7-49b0-ba0a-294ed9697cf8 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:16.922169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 299/607] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:16 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:16.927589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:16.960976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340739-6551-4c67-86e9-557803f7146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:16.961942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340739-6551-4c67-86e9-557803f7146c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:16.962171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340739-6551-4c67-86e9-557803f7146c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:16.962499 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340739-6551-4c67-86e9-557803f7146c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:16.989294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56340739-6551-4c67-86e9-557803f7146c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-56340739-6551-4c67-86e9-557803f7146c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:17.005002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:17.006055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:17.007444 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 309/608] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:17.012935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340739-6551-4c67-86e9-557803f7146c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.056388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cf188-74eb-4565-bac9-c0b3e9934a6e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.061166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.101602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.103164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.103776 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.104308 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.105903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:17.106431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:17.108109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:17.113018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.131419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 300/609] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:17.133101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.166117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56340739-6551-4c67-86e9-557803f7146c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.205718 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.206397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.206837 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.207116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.207977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:17.208286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:17.209705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:17.218756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 310/610] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:17.224146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.244276 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d62cdc-c0c2-4269-932e-e720c87cdaeb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.301186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.302338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.302621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.302898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/79e38a947d4a42f68cb6457ae2101234/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.332601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=79e38a947d4a42f68cb6457ae2101234, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:17.334055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:17.380235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243968-26f7-41cd-b7a5-bcd03e570bc9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.397820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.411711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 301/611] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:17 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/79e38a947d4a42f68cb6457ae2101234/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:24:17.412641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.429517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.430314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.430598 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.430873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.447713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:17.449285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-8f593cbb-1e93-463d-8739-75ff8a9b7915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:17.472168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:17.473214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:17.474099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:17.474099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:17.474099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:17.474099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:17.475825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 311/612] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:17.480979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.608527 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d480d8-a6d8-4dc3-bcd5-22e97d7d5fdb None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.608894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d480d8-a6d8-4dc3-bcd5-22e97d7d5fdb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.609140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d480d8-a6d8-4dc3-bcd5-22e97d7d5fdb None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.610907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 312/613] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:17.622816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.623716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.623966 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.637330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803186d4-a4ae-47f7-ac2c-068085e8ef6a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.669699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:17.672083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:17.674667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.676888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.676888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.676888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:17.676888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:17.676888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:17.678221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:17.690393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 302/614] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:17.695806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.765670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.766676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 313/615] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:17.791311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:17.904733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d011ea-8625-41bd-aaf5-ba6cc9962031 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.962553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6244b-7125-4f17-a0cc-04ce71c8fa23 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:17.965720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:17.985743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:17.986597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:17.986880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:17.987201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.003214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.004293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.004825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.005324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.006945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.008433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.017819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:18.026100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:18.027036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:18.027898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:18.031101 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 314/616] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:18.036452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:18.040628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:18.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:18.042536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 303/617] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:18.049299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.195617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d84e9b-0ecb-4293-9024-d249e013dcb4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.214137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:18.236571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.239252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.241069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.241815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.242855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:18.244456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.248215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.261200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f139ca-5c99-40f7-9323-9a9c87616d12 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.282966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 304/618] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:18.288558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.330832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.332111 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.333621 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.335352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.336326 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:18.336886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.338654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.358380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 315/619] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:18.364435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.406780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:18.480542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69167d6c-9f88-4d89-84a7-949ffc8a6059 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.500567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d7865-4a14-44ff-a868-508063b8140d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.537567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.538736 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.539226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.539694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.550987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.552701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:18.571814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:18.572767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:18.573654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:18.573654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:18.573654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:18.573654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:18.576741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 316/620] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:18.588438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.588438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.588438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.588438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.588869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.607674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.609364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:18.638577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:18.640173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:18.641288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:18.641288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:18.641288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:18.641288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:18.649146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 305/621] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:18.652331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.705074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:18.729983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:18.786481 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000441d6-36f4-4e2f-a069-fc7ff9e89f21 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.831330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330c7f2-0ebf-490f-87cc-48def69181f1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:18.853645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.854312 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.854590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.854861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.855576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:18.855877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.857832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.885935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 317/622] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:18.889903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:18.906036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:18.906701 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.906980 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.907253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.907975 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:18.908277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:18.909668 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46429016-b808-47ed-b655-d0106475f5c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:18.932852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 306/623] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:18.934783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2b97-b996-44a1-812f-b42311cd2a3a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:18.935303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2b97-b996-44a1-812f-b42311cd2a3a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:18.936359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2b97-b996-44a1-812f-b42311cd2a3a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:18.942326 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 307/624] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:18.942326 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2b97-b996-44a1-812f-b42311cd2a3a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.023996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571ba3e-f131-443a-925f-4bc9e54869ce None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.040982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.054922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2b97-b996-44a1-812f-b42311cd2a3a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.063597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.069999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.071082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.071466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.071864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.083611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.085687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.098684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.099606 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.100005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.100349 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-c030da0e-5ddf-4656-886e-b5168349b33f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:19.102183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:19.103277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:24:19.104244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:19.106891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 318/625] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:19.108958 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.109487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.109602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.110069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.110971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:19.126670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:19.127638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:19.128574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 308/626] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:19.132175 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:19.132739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.133880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:19.207204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 319/627] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:19.215854 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.260416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f5c4-f01c-4c59-8ba2-458454465503 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.298062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.298766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.299051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.299324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.300650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:19.301202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.302776 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.325186 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 309/628] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:19.326365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.336621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.344630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd728e2-7a22-4b72-9e02-181f1018cba4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.369410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.381815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b477-4099-4505-beff-026325bd6935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.382488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b477-4099-4505-beff-026325bd6935 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.382768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b477-4099-4505-beff-026325bd6935 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.383045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392b477-4099-4505-beff-026325bd6935 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.383832 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392b477-4099-4505-beff-026325bd6935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:19.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392b477-4099-4505-beff-026325bd6935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.385640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392b477-4099-4505-beff-026325bd6935 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.397535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 320/629] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:19.398371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b477-4099-4505-beff-026325bd6935 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.449741 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74654587-af8b-48d9-9d6b-27a787999a04 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.486210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.487000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.487283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.487543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.498072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d7235c52-3abf-4b4f-a73a-c50e85d0c593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:19.506279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:19.507250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:19.508084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:19.508756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392b477-4099-4505-beff-026325bd6935 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.509158 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 310/630] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:19.509158 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c035-6c2f-436c-bcd7-b2441d414507 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.509323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c035-6c2f-436c-bcd7-b2441d414507 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.509807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c035-6c2f-436c-bcd7-b2441d414507 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.511210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 311/631] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:19.511407 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c035-6c2f-436c-bcd7-b2441d414507 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.548215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.548827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.549110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.549387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.581528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.601849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.620169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c035-6c2f-436c-bcd7-b2441d414507 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.620729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.622191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.656691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.657585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.657860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.658140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/5a6b2fb527f041f7ba3c2447b824141c/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.673006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=5a6b2fb527f041f7ba3c2447b824141c, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.674442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68de5c-cc05-476f-b59d-c9cdc4f6c95f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.723635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 321/632] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:19.724291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.736658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 312/633] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:19 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/5a6b2fb527f041f7ba3c2447b824141c/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:19.738178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.738647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.738978 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.757643 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:19.758979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:19.830298 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.848450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 313/634] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:19.848450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.870335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed608c50-71b3-47af-9550-986ba7da0f03 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:19.913034 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:19.913719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:19.914005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:19.914285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:19.915045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:19.915358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:19.918273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:19.927024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:19.928760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 322/635] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:19.929614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:19.986495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58be0b-1cab-486e-b489-3682effc8d80 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.024221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.025042 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.025326 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.025719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.034857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082550a-5221-4c72-8ad3-592e6ed3987c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.038132 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.039573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:20.058127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.059937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:20.059937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:20.059937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.059937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:20.059937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 314/636] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.060230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.075915 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.077277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.077564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.077843 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.088199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-894527ae-75f2-498b-8e35-3ade1f71c39a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:20.095923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.096896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:20.097731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 323/637] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.099020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59826b2-76eb-49f8-8d6e-c98813357b03 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.099020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59826b2-76eb-49f8-8d6e-c98813357b03 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.099020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59826b2-76eb-49f8-8d6e-c98813357b03 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.104555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 324/638] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:20.104555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59826b2-76eb-49f8-8d6e-c98813357b03 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.108309 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.173919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.178191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284b871-2c43-4281-84ce-cdbc6093f2db None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.214530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59826b2-76eb-49f8-8d6e-c98813357b03 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.216800 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbd15-0526-4041-9008-09564f194249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.217837 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbd15-0526-4041-9008-09564f194249 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.217950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbd15-0526-4041-9008-09564f194249 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.218242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fbd15-0526-4041-9008-09564f194249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.229288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fbd15-0526-4041-9008-09564f194249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.230730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fbd15-0526-4041-9008-09564f194249 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-686fbd15-0526-4041-9008-09564f194249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:20.249165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.250118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.251016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:20.251016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:20.251016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.251016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:20.251016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 315/639] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.251306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbd15-0526-4041-9008-09564f194249 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.260299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.261020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.261302 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.261581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.262301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:20.262606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.264583 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dc6eb-3acb-4fb6-82d6-2d9b25e79c21 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.276386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 325/640] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:20.278611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.279134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.279729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.299410 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:20.300624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:20.358259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fbd15-0526-4041-9008-09564f194249 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.362019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.371475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 326/641] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:20.372104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.405956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.406632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.406912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.407191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.407938 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:20.408242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.409678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.423052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 316/642] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:20.423052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.434991 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.483639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23141f-f962-43ea-af48-decd71bb5b2a None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.521844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a552ca-dcc2-4b92-a511-12cd740701a2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.526505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.527174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.527458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.527737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.528481 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:20.528790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.530609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.548554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 327/643] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:20.549380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.562686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.563227 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.563511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.563783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.570578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.572015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:20.586919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.587899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 317/644] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.588842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.608734 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.651143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef0264-61c3-4172-96fa-cd10befa3f65 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.665607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.685945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.686727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.687008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.687280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.697560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:20.697798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a49f-18a2-4309-bd5f-44212b2e79ef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:20.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.706155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:20.707135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 328/645] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.707862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.736633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.737541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.737825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.738097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.749096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.750661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:20.769154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.770099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.771003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:20.771003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:20.771003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:20.771003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:20.771003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 318/646] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.771277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.814357 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b3ada-bfac-42fa-9efc-34f1a476dc6f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.829328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.850984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.851778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.852064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.852343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.861275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.863323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:20.879218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:20.880263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:20.881265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 329/647] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:20.882976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.888802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9692c24-3264-47f6-94bf-1d40f44663f6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:20.916009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:20.928901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:20.929576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:20.929856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:20.930133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:20.930944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:20.931254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:20.932737 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:20.945229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 319/648] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:20.946271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:20.997133 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca055-af3f-416b-88ea-9b14534ba32f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.032604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.033271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.033555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.034057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.034578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.034884 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.036256 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.049456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 330/649] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.049456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.054017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0c9fa-e469-42a5-93e5-e89131e43400 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.085472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.088019 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.088710 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.089001 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.089278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.089997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.090299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.092194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.108214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 320/650] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.108214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.155285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643f1cd-b143-4242-ac0c-523a75fe741b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.155707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.197013 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.197879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.198162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.198433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.199295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.199602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.201584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.218873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c4757-ce0e-40a2-b892-0e40ff3e3be6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.220965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 331/651] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.221785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.259631 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.260280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.260596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.260877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.261695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=65b5d79ac93d475ab781370bd3ca4877) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.262015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.263965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.270133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 321/652] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/role_assignments?user.id=65b5d79ac93d475ab781370bd3ca4877&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.270720 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.351183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.361534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e987a0-928c-4287-ad51-7bc09d745020 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.393692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74821d3a-30ae-4c86-9405-5ca376e2843e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.407829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.414662 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.416129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.420802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.420802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.431908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.433688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.440698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.441512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.441797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.442112 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.452216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.456446 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:21.460537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:21.461429 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:21.462382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:21.462382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:21.462382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:21.462382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:21.462382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 332/653] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:21.463070 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:21.472575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:21.473565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:21.474684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 322/654] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:21.475289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.593866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfccca4-cb50-4752-8a11-4fbc43ee99e8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.600279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eae6d-090f-4918-9d79-7c279b80a58f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.632533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.633411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.633769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.634118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.634926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.635300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.637285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.646915 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.648585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.649151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.649609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.651206 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 323/655] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.652167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.670783 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.686101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.741681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.743619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aec419-45d5-45e9-9ca6-daaba6d81151 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.772889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e496e0e-62a2-4b56-b9e3-0886e155a912 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.820258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.820965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.821247 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.821520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.822363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:21.822671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:21.824101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:21.842500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 324/656] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:21.843684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.859755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 333/657] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:21.861036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeef03-0e86-4081-9fc5-5f2d4fb15697 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.861413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeef03-0e86-4081-9fc5-5f2d4fb15697 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.861760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeef03-0e86-4081-9fc5-5f2d4fb15697 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.867555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 334/658] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:21.868276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeef03-0e86-4081-9fc5-5f2d4fb15697 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:21.917905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.936132 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:21.954167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb2bb-c162-4409-b96b-76d57b2d7466 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.974520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeef03-0e86-4081-9fc5-5f2d4fb15697 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:21.989987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:21.990779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:21.991311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:21.991588 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:21.999509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.000989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.010820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.011457 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.011768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.012074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:22.015494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:22.016485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:24:22.017443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:22.021341 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:22.022168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.086100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.087571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb693-fc91-48f2-817a-27aa6e41f058 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.134019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.137726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767860c-b5a7-4af7-ba16-2221d6a6a38b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.172937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.173722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.174005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.174280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.188972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.190369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.199255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 335/660] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:22.199255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.199255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.199255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.200148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:22.213462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:22.214389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 326/661] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:22.220787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.221149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:22.221992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:22.291451 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 336/662] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:22.292576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.331902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3ff51-0cb6-4641-b2a8-c13f66082b9a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.366772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.367439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.367732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.368006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.368874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:22.369185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.370593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.376179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.388559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 327/663] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:22.389354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.404650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd4b66-7e02-4582-9ca1-25f6452879d9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.441487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.442195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.442477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.442748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.447102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.453161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.454587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:22.472766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:22.473679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:22.474728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:22.474728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:22.474728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:22.474728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:22.474728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 337/664] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:22.479051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.499476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4da0b-bbe0-4ee1-a0e4-0bd6a8d2515a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.535135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.535804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.536092 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.536360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.537114 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:22.537421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.538781 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.555660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 328/665] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:22.556526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.587958 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840529-4e22-4c39-b8fe-9f37dd2fee7d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.614496 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.622790 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.623578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.623870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.625457 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.635378 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:22.644690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:22.645855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:22.646901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:22.649486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 338/666] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:22.650376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.663861 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b99ca-df77-48fd-afb9-b99595e5d327 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.681512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.700548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.701651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.701940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.702219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.759423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec6e1-2914-4fdf-ba7e-514742f7b2e8 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.773670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.775300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.797605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.798265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.798549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.798825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.799606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:22.799917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.801340 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.813004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 339/667] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:22.813786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.863132 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.883920 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 329/668] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:22.889436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.907301 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:22.922789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de88d52-6c11-4739-9f76-ea6cd0c1fa7a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:22.958286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:22.959025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:22.959308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:22.959579 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:22.967285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:22.968750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:22.984129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:22.985107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:22.986026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 340/669] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:22.986512 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:22.996959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469eba4-9fc2-4a2e-8c47-6dbc4ee6062b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.035786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.036625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.036912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.037191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.037942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.038250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.039875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.053746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 330/670] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.053746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.093528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887eded2-150c-492a-bc92-43b7f16e3e3d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.103037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.129086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.129882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.130170 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.130449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.134722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.139420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.141860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.156912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25a307-6522-4a15-9f41-5e2cdc1d1bb8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:23.157893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:23.158729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:23.159618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:23.161762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 341/671] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:23.162751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.201305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.202089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.202369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.202644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.213826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.215204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:23.233234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:23.234156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:23.235069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:23.235069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:23.235069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:23.235069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:23.235069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 331/672] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:23.236051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.287511 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1968f-04a5-44f4-87d3-38dee66f6d42 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.325376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.326435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.326866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.327289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.328210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.328792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.330477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.341254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779530f9-8688-4d3b-9ba9-5e69bc372cb6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.343905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 342/673] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.344896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.374973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.380028 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.380997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.381790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.382073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.382358 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.393291 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.394729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:23.412185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:23.413278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:23.414192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:23.414192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:23.414192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:23.414192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:23.414192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 332/674] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:23.414476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.459732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff848cb-0e96-4d43-8db3-3f5806511044 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.492869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.493452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.493729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.494000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.494769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.495077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.496520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.509255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 343/675] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.509853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.518758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30ba5d-1010-4b25-af52-196e1d7cd145 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.551687 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.552343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.552658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.552931 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.553653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.553957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.555310 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.567290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 333/676] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.568063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.599305 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.609077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.611248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e69993-6124-4797-b367-eb709f719d46 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.645091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.645705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.645924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.646199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.647020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ec4e612bcb464df28bcf900197a64449) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.647336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.648779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0e5a6-4519-40c3-af01-4905badfd01b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.654969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 344/677] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/role_assignments?user.id=ec4e612bcb464df28bcf900197a64449&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.656241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5130e-acb3-4937-85ea-46b1c8adeaec None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.656564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5130e-acb3-4937-85ea-46b1c8adeaec None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.656845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5130e-acb3-4937-85ea-46b1c8adeaec None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.658063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 345/678] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:23.658760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5130e-acb3-4937-85ea-46b1c8adeaec None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.674245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81ed9-f15a-40a3-9e80-3febd98ea86f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.711880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.712595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.712882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.713155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.713899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.714203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.715608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.733527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 334/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.733527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.792735 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5130e-acb3-4937-85ea-46b1c8adeaec None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.835689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.836350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.836722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.837001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.837836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:23.838149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.840498 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5b9ec-52f3-474d-a4c2-0a4427f892d4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.849890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 346/680] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:23.849890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.850136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d545-d6a6-407d-9b47-45b611a97203 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:23.850226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.850226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.850916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.869676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:23.870905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:23.892831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:23.893636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:23.893923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:23.894198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:23.902258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:23.902505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:23.903730 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:23.920387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:23.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 335/681] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:23.922899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:23.963798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 347/682] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:23.965212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.047365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5004367-3d87-4d62-b1fe-d43a95bccf15 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.089538 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.090480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.091093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.092074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.100645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.102328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.106951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e181a7-9f84-46bd-9f4c-8628e8905ff6 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:24.121464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:24.122727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:24.123896 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:24.126372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 336/683] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:24.127369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.153604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.154903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.155180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.155447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.156225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:24.156338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.156568 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.157999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.175972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 348/684] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:24.177170 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.198288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.251193 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2c888-4838-4d63-93cc-ff1f1e41a16c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.302523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.303235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.303511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.303787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.309484 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5974ef-d9e4-481c-b1b0-dcd95956310b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.318964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.320886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.347102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.347877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.348246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.348629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.349532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:24.349911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:24.350725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:24.351600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:24.352707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:24.352707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:24.352707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:24.352707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:24.352932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.359400 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 337/685] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:24.359400 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.376454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 349/686] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:24.376454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.456835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.459751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.475925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714845f-7ecb-45db-883a-15d7b1f3f5e3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.511166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c13d6-d0d3-468b-8a17-edabb83aa331 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.522707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.523770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.524067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.524348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.525592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=79e38a947d4a42f68cb6457ae2101234) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:24.525913 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.527607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.536482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 338/687] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:24 2022] GET /identity/v3/role_assignments?user.id=79e38a947d4a42f68cb6457ae2101234&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:24.537579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.570233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.571330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.572639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.573140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.574094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:24.575507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.578657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.604639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 350/688] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:24.608023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:24.740098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fa6e2-8c91-4cd9-8398-44b493404c62 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.785368 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b815c2-e249-4820-b9b7-59f7e8594f37 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:24.786509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.787434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.787963 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.788541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.800581 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.816003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:24.827676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:24.828309 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:24.828651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:24.829226 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:24.830825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.831666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.876335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:24.878161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:24.907263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 351/689] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:24:24 2022] POST /identity/v3/users => generated 254 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:24.999171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 339/690] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:25.004544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:25.144016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aee50-ddde-4bb1-9337-e7c6f9cff724 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:25.180304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:25.181443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.181907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.182383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.199092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:25.200974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:25.219680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:25.220711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:25.221633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:25.221633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:25.221633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:25.221633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:25.223809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 352/691] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:25.230078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:25.271196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:25.334477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32563399-8987-48b9-ba98-64e1e439ac57 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:25.370450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:25.371113 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.371399 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.371675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.372442 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:25.372764 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:25.374194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:25.386249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 340/692] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:25.391307 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:25.436190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:25.507346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02566519-f97b-42ea-8fe6-9fa26111ec04 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:25.542803 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:25.543659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.543943 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.544303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.552562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:25.554113 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:25.568150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:25.569134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:25.570617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 353/693] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:25.574914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:25.726805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:25.730862 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936ed20-db0c-41a5-b8c7-f5a9804fa026 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:25.771882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:25.772689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.772856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.773123 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.773904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:25.774212 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:25.775629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecd5b9-720d-40d2-8cc8-ba5cd032a9ac None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:25.797831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 341/694] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:25.803684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:25.904904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:25.913503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e902b71-d562-42fa-8eb5-c584f3b9513e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:25.924805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2252ba-e57b-4674-b0a1-d5a987ab8daa None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.925107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2252ba-e57b-4674-b0a1-d5a987ab8daa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.925428 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2252ba-e57b-4674-b0a1-d5a987ab8daa None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.926977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 342/695] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:25.931847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27e6a-da93-4ba0-949d-528aa3248244 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.932138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27e6a-da93-4ba0-949d-528aa3248244 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.932427 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b27e6a-da93-4ba0-949d-528aa3248244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.951314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:25.951979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:25.952263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:25.952575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:25.953879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=5a6b2fb527f041f7ba3c2447b824141c) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:25.954195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:25.955646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:25.962884 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 354/696] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:25 2022] GET /identity/v3/role_assignments?user.id=5a6b2fb527f041f7ba3c2447b824141c&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:25.969559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d1b27e6a-da93-4ba0-949d-528aa3248244 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:25.970775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d1b27e6a-da93-4ba0-949d-528aa3248244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:26.093478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 343/697] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:24:26.137449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:26.263577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5853e-050f-49e2-9fe3-60d157272e1d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:26.299207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:26.300023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.300304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.300612 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.301270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:26.302644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:26.307674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86669-e868-4010-a48d-dc79d09b1f9b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.307967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86669-e868-4010-a48d-dc79d09b1f9b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.308305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc86669-e868-4010-a48d-dc79d09b1f9b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.309925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 344/698] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:26.314920 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.315211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.315491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:26.316973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:26.317924 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:26.318926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 355/699] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:26.324549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:26.342663 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:26.343898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:26.348784 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:26.421128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 345/700] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:26.429670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2305b25-2695-497c-98b0-42c1c3bd826f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:26.445965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:26.473981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:26.488736 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:26.490688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.490688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.492283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.492712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:26.493085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:26.494534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:26.501505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:26.510119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:26.589587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfac2b1-729b-4e72-8387-100a041530e5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:26.606327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:26.624900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944bda0-51f6-4ce2-94a5-88b9d5499597 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:26.642103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:26.643243 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.643747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.644218 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.665040 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:26.673275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:26.674213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:26.675077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:26.683891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:26.696458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:26.696458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.696458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.696458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.696857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:26.696857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:26.696857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:26.698200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:26.703840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:26.858624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:26.883365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a74c0d-42a8-41a5-8f4e-54a993bfe4d1 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:26.928028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:26.928813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:26.929140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:26.929365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:26.930131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:26.930618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:26.932026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:26.944816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 347/704] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:26.952627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.063318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232665b6-79e7-46ed-92e8-872529594a25 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:27.099335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504055fd-26a7-4282-8367-a50905962083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:27.100152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504055fd-26a7-4282-8367-a50905962083 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.100465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504055fd-26a7-4282-8367-a50905962083 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.100749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504055fd-26a7-4282-8367-a50905962083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.117236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504055fd-26a7-4282-8367-a50905962083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:27.118620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504055fd-26a7-4282-8367-a50905962083 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:27.130540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-504055fd-26a7-4282-8367-a50905962083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:27.143303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:27.144704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:27.145661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:27.145661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:27.145661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:27.145661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:27.145661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 358/705] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:27.151988 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.257304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4b2-f645-43c4-839d-613b00de7a4b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.257695 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4b2-f645-43c4-839d-613b00de7a4b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.258069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1f4b2-f645-43c4-839d-613b00de7a4b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.259815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 359/706] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:27.267300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144142-075a-4fa8-972d-feda038da7db None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.267658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144142-075a-4fa8-972d-feda038da7db None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.268007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a144142-075a-4fa8-972d-feda038da7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.295468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86ce61-8b47-44fa-be10-984a5ceab878 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:27.307012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-3a144142-075a-4fa8-972d-feda038da7db None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:27.308544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-3a144142-075a-4fa8-972d-feda038da7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:27.358820 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:27.359783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.360242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.360736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.361645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:27.362294 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:27.364883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:27.386907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:27.392456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:27.397927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.437235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 360/708] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:24:27.499005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a144142-075a-4fa8-972d-feda038da7db None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.540790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004b8c2-7acc-4efc-8e99-9e1f17603ac8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:27.605027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:27.606159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.606618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.607142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.621224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:27.623902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:27.656215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:27.657220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:27.658156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:27.660975 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 349/709] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:27.668051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.673209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a144142-075a-4fa8-972d-feda038da7db None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:27.734890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:27.749907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:27.750705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.750983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.751255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] PATH_INFO: `/v3/services/network` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.751904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:27.753402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:27.779919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:27.781006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:27.781858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:27.783212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 361/710] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/services/network => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:27.786899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:27.789609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.878370 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21458530-71c4-4873-9113-db6cfb13f089 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:27.916216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:27.917407 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.917891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.918362 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.919907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:27.920450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:27.922315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b181e-ac73-47de-8908-0f977959729f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:27.942145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 350/711] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:27.943693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2edced-4fc3-4ab1-959f-25a05498cee9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:27.944177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2edced-4fc3-4ab1-959f-25a05498cee9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:27.944815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2edced-4fc3-4ab1-959f-25a05498cee9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:27.946503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 351/712] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:27.948252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2edced-4fc3-4ab1-959f-25a05498cee9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:27.968971 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9a3ab-d068-4eca-9bf4-69fdf5c69d29 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.016338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.017029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.017304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.017577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.018596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:28.018902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.020727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc96b3-53b4-4862-8c39-ca7ca09f40d9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.025976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 362/713] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:28.027343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.027627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.027899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.048891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:28.050352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:28.068335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2edced-4fc3-4ab1-959f-25a05498cee9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.088086 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.109061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.110171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.110823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.111298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.118431 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.140439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 363/714] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:28.140439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.221303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.222757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.260248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d9729-682c-49f3-be16-6f70fd0eee4b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.296390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.297526 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.298060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.298563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.299471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] RBAC: Adding query filter params (type=network) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:28.299974 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.301605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.306819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 364/715] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:28.307925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.338962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 352/716] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:24:28.340294 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.361410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.366187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.418528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc3e9f-3722-40b0-be01-82d268b015fe None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.456082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f1aeb-92d9-4c40-9165-7e1b3aa7317f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.456526 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.457426 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.457779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.458126 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.479810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:28.493091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:28.494177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:28.495025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:28.497772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 365/717] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:28.505588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.550503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.551795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.553473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.555266 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.568686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.570541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:28.594443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:28.595439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:28.596329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:28.596329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:28.596329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:28.596329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:28.603066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 353/718] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:28.604637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.651445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d68de2-6121-4da7-b6f7-64cd1ac768cb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.666219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.682675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.692748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.693417 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.693757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.694032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.694793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:28.695078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.696476 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.716730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 366/719] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:28.716730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.725447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d01573-5ecd-40d1-bc09-14a52563cd01 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.785087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.786196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.786761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.787115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.787910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:28.788279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.789755 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdc98-991e-45db-8c07-3f2983f8f142 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.806897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 354/720] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:28.808438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac33bb-5b0e-4aae-982f-60b6542a52bd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.808802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac33bb-5b0e-4aae-982f-60b6542a52bd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.809144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac33bb-5b0e-4aae-982f-60b6542a52bd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.810818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 355/721] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:28.811719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac33bb-5b0e-4aae-982f-60b6542a52bd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:28.829396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd54131-8ed7-4917-9d57-a35d086bba42 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.878335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.879260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.879655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.880039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.892818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.894435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-364ea051-866e-4620-94dd-d354437184b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:28.913910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:28.914845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:28.915743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:28.915743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:28.915743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:28.915743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:28.915743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 367/722] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:28.917214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.917569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.917918 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.936142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:28.937771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:28.942271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac33bb-5b0e-4aae-982f-60b6542a52bd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:28.960363 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.983989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:28.986121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:28.987133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:28.987592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:28.988379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:28.998246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:28.999931 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.018293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 368/723] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:29.019771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:29.021923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:29.025305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:29.026204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 356/724] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:29.028899 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.131441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7644b9a-3fd1-4206-95af-90b40f75f8af None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.158471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc93152-4b43-407c-ba10-558c3893a349 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.166895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.167558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.167846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.168180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.168931 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:29.169327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.170719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.192615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 369/725] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:29.193840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.195341 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.196007 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.196291 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.196806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.198536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:29.198855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.200979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f55462-884b-4228-a744-40e54f64bbf9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.214035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.218759 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 357/726] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:29.220346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dbe7-a884-4e30-b123-1c8662b1da2e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.221045 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dbe7-a884-4e30-b123-1c8662b1da2e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.221264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221dbe7-a884-4e30-b123-1c8662b1da2e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.222619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 358/727] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:29.227874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221dbe7-a884-4e30-b123-1c8662b1da2e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.280891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.302291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f1a6e-4531-4d31-bf84-163bbcb05f12 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.336904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221dbe7-a884-4e30-b123-1c8662b1da2e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.339978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.341103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.341611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.342091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.355775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:29.364629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:29.365581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:29.366698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:29.370885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 370/728] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:29.371565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.373818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.374787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.375072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.376136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.385134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.386497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f67308a9-359a-46d6-ba81-2ac8da82b287 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:29.401167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:29.402107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:29.403067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 359/729] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:29.403703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.403782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.404482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.421476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:29.422650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:29.455810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.479300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb549fc-f253-4629-991a-5b99bb16a537 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.492517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 360/730] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:29.493518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.515584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.516497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.516928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.517351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.518320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:29.518861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.520456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.526164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 371/731] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:29.527084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.548970 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.628539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39400a42-8c8f-4b06-9f19-5e858f969f9e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.657200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c41e81-c48c-4029-bad1-7f56d17007b9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.668839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.670100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.670385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.670663 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.671430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:29.671742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.673196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.687522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 361/732] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:29.688505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.702100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.702100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.702100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.702464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.703124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:29.703434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.706425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.716891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.734408 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 372/733] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:29.735578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:29.815873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102c58-c022-44b9-a526-280a16c081dd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.817539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:29.876185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d93-96cb-47b3-94fb-55fcc459b376 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:29.877203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.877866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.878146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.878418 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.879388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.880883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.915580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:29.916822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:29.917314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:29.917807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:29.933910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:29.935737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:29.983454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 362/734] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:29 2022] POST /identity/v3/services => generated 251 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:29.984631 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:30.075772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:30.077110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:30.077990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:30.077990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:30.077990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:30.077990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:30.080601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 373/735] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:30.087431 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.126994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e9a11-61e3-413f-8638-35f866ada475 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.156343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.167413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.173676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.173676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.173676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.207569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.226424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e06fc-55a5-4e19-8eb6-4815be75a163 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.277849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.279968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.284816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.285491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.285781 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.286062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.286782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:30.287089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.290255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.304582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 374/736] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:30.313636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.402578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 363/737] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:30.409584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.432284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdaeea-c5f3-4248-abb1-7c60f14ec4bb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.448658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.486504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.487301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.487581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.487856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.491297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.502877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.504336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.532846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87c1b3-8c1c-4454-a371-a69e2359c631 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:30.541465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:30.542668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:30.543774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 375/738] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:30.549031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.571842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.572918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.573371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.573808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.584947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.586592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:30.604746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:30.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:30.607057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:30.607057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:30.607057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:30.607057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:30.609093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 364/739] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:30.614151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.720333 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416febb3-225f-4d8f-895b-0d0347ca1562 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.732850 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.750326 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dfda-f57d-4a5b-a3f6-4277d45382f3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.779535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.780194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.781512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.786360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.786360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:30.786360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.786360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.821934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.822638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.822917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.823190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:30.824445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:30.824873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 365/740] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:30.825933 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.826068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024f11d-5ed5-4532-a13c-34572dd11e36 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:30.846838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 376/741] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:30.852740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41550c-0c14-4799-9e68-10bf9dab0631 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.853113 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41550c-0c14-4799-9e68-10bf9dab0631 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.853396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41550c-0c14-4799-9e68-10bf9dab0631 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:30.859349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 377/742] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:30.859349 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41550c-0c14-4799-9e68-10bf9dab0631 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:30.887268 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:30.949330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483d3a1-87cc-4307-9338-49f6daf3896a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.966753 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41550c-0c14-4799-9e68-10bf9dab0631 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:30.988853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:30.990614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:30.991538 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:30.991959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.001801 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.003395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.005104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.005874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.006184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.006564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-819a00c7-add6-46f3-a46d-8b2e7d4b477d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:31.020249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:31.021181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:31.022084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:31.024799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 366/743] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:31.026122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.026552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.026972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.052376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:31.053612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:31.084812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.086994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.116589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.144221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 367/744] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:24:31.145344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.207741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 378/745] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:24:31.208907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.270934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3797f8-c7f6-4a65-a2ff-9c37fd7065ba None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:31.308130 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.309204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.309716 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.310190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.311293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:31.311849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.313728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.327302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 368/746] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:31.328385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.342728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad176c69-021f-43c0-b358-513107d09cb9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:31.355378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.379065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.388739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.389400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.390095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.390369 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.391402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.393084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.439470 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580862d-6876-48bf-8cbf-b8d59bff3917 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:31.467205 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 379/747] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:31 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:31.468847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.480180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.481145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.482066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.482391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.513783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.515414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:31.561352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:31.562826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:31.564229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:31.564229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:31.564229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:31.564229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:31.564229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 369/748] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:31.570768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.610740 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d3d4-41e9-4b04-a5c6-68c8aca75914 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:31.651190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.652114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.652573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.653017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.654626 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=b55e15e1ac0f4edc972a89f07c7bea18) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:31.655086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.657486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c966cc-89d5-4af6-a3a1-e864b84d77e6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.664952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 380/749] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/role_assignments?user.id=b55e15e1ac0f4edc972a89f07c7bea18&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:31.733667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.769733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b73-ee16-40a6-b69e-8a935d3c3bdf None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.770059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b73-ee16-40a6-b69e-8a935d3c3bdf None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.770338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9b73-ee16-40a6-b69e-8a935d3c3bdf None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.772146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 381/750] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:31.778230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.779289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78892d45-b3b8-42fa-a945-4ec96fcb9d83 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:31.779607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.780079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.800188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:31.801770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:31.824676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:31.825964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:31.826775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:31.826775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:31.827205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:31.827515 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:31.830151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:31.850654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 370/751] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:31.856501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:31.871530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:31.911541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 382/752] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:31.961613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.032759 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9aa2b3-0e4d-4fcb-a721-fc25fddb9fa9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.094564 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:32.105252 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c2d76-3530-4e1b-a64c-bba5852b0f1d None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.116868 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.117667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.117945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.118213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.130464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.131901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:32.152521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:32.153499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:32.154431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 371/753] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:32.161134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.183357 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.184218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.185040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.185360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.206013 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:32.225701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:32.226720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:32.227565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 383/754] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:32.237362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.285406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c52be-5576-4edd-9c7e-f6039abb9f2d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.321109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.322140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.322637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.323131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.324109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:32.324647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.326323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.331972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:32.339928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 372/755] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:32.352883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.401751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:32.451214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa21ef0-51ce-4ec2-acbe-90fb2fa0203a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.460705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741fd80-96bc-4bf3-8221-2e7af34080f0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.486957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.488008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.488533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.489008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.490038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=5a6b2fb527f041f7ba3c2447b824141c) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:32.490572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.492464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21b7a8-8ae3-4240-94bb-716a6d5cb810 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.499475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 373/756] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/role_assignments?user.id=5a6b2fb527f041f7ba3c2447b824141c&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:32.529740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031134be-c478-43c5-a396-6a37a3fcef11 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.530399 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031134be-c478-43c5-a396-6a37a3fcef11 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.530898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031134be-c478-43c5-a396-6a37a3fcef11 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.532767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 374/757] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:32.542627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db475200-6fad-4e20-b787-129da4f74448 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.543254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db475200-6fad-4e20-b787-129da4f74448 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.543732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db475200-6fad-4e20-b787-129da4f74448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.549374 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.550061 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.550343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.550618 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.551420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:32.551666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.553601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.565657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-db475200-6fad-4e20-b787-129da4f74448 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:32.567230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-db475200-6fad-4e20-b787-129da4f74448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:32.572210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 384/758] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:32.577761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.645655 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 375/759] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:32.671693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db475200-6fad-4e20-b787-129da4f74448 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.724789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:32.789322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4501bb9-5f50-4b6f-a721-61d033bb7782 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.792950 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:32.798481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db475200-6fad-4e20-b787-129da4f74448 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:32.838853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.840149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.841176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.841658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.842549 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.844129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:32.861404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:32.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:32.863236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:32.864035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:32.864661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:32.864961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:32.865239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:32.867118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 376/760] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:32.873511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:32.889245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:32.890710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:32.910596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:32.911522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:32.912466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:32.912466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:32.912466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:32.912466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:32.912466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 385/761] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:32.917856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.041080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960dba-36c9-459a-b177-a41f451abf46 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.048918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.061632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de40e9-f546-4e15-8a36-d08391f920a1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.100792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.101719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.102073 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.102460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.103255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:33.103660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.105286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.119363 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 386/762] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:33.125248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.144140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.151148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.153889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.155015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.155818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.157185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:33.158887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.160481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.169725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 377/763] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:33.176044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.301386 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3018d-430d-48af-ae02-c1500590376a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.340769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b318b-a90c-49d3-b6c0-a7ee34b729f0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.344910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.345581 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.345864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.346134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.346841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:33.347145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.348533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.364554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 378/764] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:33.368658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.417441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.418238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.418518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.418824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.428958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.438343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.439907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:33.457903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:33.459098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:33.460288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 387/765] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:33.465900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.560283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282aa5-0a10-456f-adf0-c53f2d5d41f6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.598052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.609957 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65c4b2-6afc-4f52-a38b-d621efe70e3e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.645658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.646617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.647050 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.647471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.648485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:33.648964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.650612 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.657738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.658416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.658699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.658973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.659767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] RBAC: Adding query filter params (interface=public, service_id=b021145053bc4e38abaa7ac935d682f8, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:33.660076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.662241 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.670920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 388/766] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:33.681517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.682621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 379/767] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/endpoints?service_id=b021145053bc4e38abaa7ac935d682f8&interface=public®ion_id=RegionOne => generated 194 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:33.693389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.783747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edac1f0-e02b-49ea-bd20-e9a6bb5f2768 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.826693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.827490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.827770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.828046 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.833936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.848138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.849635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.875890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6b92f-3206-4682-bfaf-554e85b60773 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:33.892969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:33.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:33.894821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:33.894821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:33.894821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:33.894821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:33.894821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 389/768] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:33.900471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:33.909120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:33.927674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:33.928723 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:33.929209 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:33.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:33.930641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:33.932265 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae30621-0119-4360-90e0-e913df3743ad None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:33.951142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 380/769] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:34.026665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e111cf-e382-4a3d-b77d-10fb4766291e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.067060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e6bc-4fe7-4713-a4d7-8484f8362b60 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.067582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e6bc-4fe7-4713-a4d7-8484f8362b60 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.067658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e6bc-4fe7-4713-a4d7-8484f8362b60 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.069331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 381/770] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:34.074434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.074960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e0cd-5473-45bd-b62f-f1d586ad4fa1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.075184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.075344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e0cd-5473-45bd-b62f-f1d586ad4fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.075439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.075628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e0cd-5473-45bd-b62f-f1d586ad4fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.075741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.076458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:34.076775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.078337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a2e4-6cb9-425a-99cd-aa16596be69a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.093067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ae19e0cd-5473-45bd-b62f-f1d586ad4fa1 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:34.094292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ae19e0cd-5473-45bd-b62f-f1d586ad4fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:34.094474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 390/771] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:34.099482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb391-3c6f-4d86-8d06-a94af5dd7c01 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.099771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb391-3c6f-4d86-8d06-a94af5dd7c01 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.100051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afb391-3c6f-4d86-8d06-a94af5dd7c01 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.101729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 391/772] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:34.102473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb391-3c6f-4d86-8d06-a94af5dd7c01 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.168461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:34.175586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 382/773] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:34.176908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.177200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.177507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.218768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:34.220675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:34.239109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afb391-3c6f-4d86-8d06-a94af5dd7c01 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.276031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.276937 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.277279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.277648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.290167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.292381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:34.311841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:34.312782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:34.313699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 392/774] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:34.314188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 383/775] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:34.317081 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.320750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.355128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:34.442864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b985d-c14c-4e6b-a3f4-cdb4e28b7628 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.454174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff4ef7-1bfd-4ca8-9c0c-d10d8fc8b89a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.462638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:34.491365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.492395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.493053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.493475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.494397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:34.494934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.495404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.496272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.496646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.497020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.497219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.508289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:34.512298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 384/776] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:34.513464 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:34.516556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:34.517503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:34.518350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:34.519202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 393/777] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:34.521017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.628722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:34.633724 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bc765-bdb6-4d30-887f-b1e2a0a1a8b3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.652611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44611-87f7-4f60-b446-99d9ce55bd6c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.673980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.675403 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.676228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.676679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.678836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=d620bd7c93f640ef8ec03ea691926996, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.681255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.694552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.695416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.695707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.695988 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] PATH_INFO: `/v3/services/network` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.696751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.698161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:34.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:34.716028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:34.716935 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 385/778] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:34.717744 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.740635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 394/779] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:34 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:34.741914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:34.781054 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:34.877386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595ed87-32ad-41bc-9e3d-bc0b87b233e3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.913683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e9d1-93ac-477f-86eb-cf5bba7a2485 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:34.920872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:34.922913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:34.923459 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:34.923927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:34.924885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] RBAC: Adding query filter params (name=network) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:34.925388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:34.927032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:34.938257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 395/780] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:34.939953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.002497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.003081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.003365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.003646 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.004412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:35.004735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.006171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.017001 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 386/781] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:35.022068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.034782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.060431 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.073633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb562707-8f48-4a58-ae59-866c3784a704 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.111228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.112009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.112356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.112738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.113513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:35.113905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.115340 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c09af-95a2-42f0-a25e-164b7e4717d0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.120982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 396/782] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:35.122376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d010a-94ed-4a3d-8a69-c69d29c600f6 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.122729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d010a-94ed-4a3d-8a69-c69d29c600f6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.123078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d010a-94ed-4a3d-8a69-c69d29c600f6 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.124640 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 397/783] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:35.129303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d010a-94ed-4a3d-8a69-c69d29c600f6 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.150015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7ac92-69ac-4f63-a1fc-821b2f738905 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.198122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.199399 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.200074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.200884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.216087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.217892 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-63281120-a2f0-4b40-87be-a26d83e94acf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:35.242945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:35.243912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:35.244844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:35.244844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:35.244844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:35.244844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:35.246144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 387/784] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:35.247337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.247624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.247902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.252562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d010a-94ed-4a3d-8a69-c69d29c600f6 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.265948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:35.267128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:35.291258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.292688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.293443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.294475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.295936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] RBAC: Adding query filter params (interface=public, service_id=a6a23bcae0d046208c0ed6cabedf62e9, region_id=RegionOne) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:35.296549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.298549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.308723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 398/785] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/endpoints?service_id=a6a23bcae0d046208c0ed6cabedf62e9&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:35.309967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.328384 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.336244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.348546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 388/786] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:35.349519 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.436375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ceee78-3d95-40c7-b5b4-48c6918f64c7 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.474077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.475050 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.475165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.475419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.476154 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:35.476467 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.477970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.482378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d3082-2090-4ae8-8b2a-ad5c6da0825b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.490107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 399/787] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:35.491228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.530030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.531034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.531542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.532021 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.532927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.534952 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.542487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 389/788] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:35.543516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.604644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.620453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.667110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09067b-f2fd-46a5-8ac8-a647a4b6ef32 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.724793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.725620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.725901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.726178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.733389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bc327-c454-497a-aaea-f9af4b71321a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.749379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:35.758794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:35.759725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:35.761065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:35.764271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 400/789] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:35.770504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.793086 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.794344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.794846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.795324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.806671 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.808653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:35.839477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:35.840633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:35.841614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 390/790] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:35.847990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:35.891718 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa9d25-9f99-4b24-9e33-5d9024a803ed None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:35.927339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:35.928002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:35.928291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:35.928599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:35.929342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:35.929649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:35.931075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:35.937057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:35.941668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:35.947177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a4db1-96c4-40ae-9e50-56ae68b53abb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.092158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.093044 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.093329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.093605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.104570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.106023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:36.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:36.126540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:36.127415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:36.127415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:36.127415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:36.127415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:36.127415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 402/792] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:36.127717 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393452d4-0975-44ad-af87-e75f69172589 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.132749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.161480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.192528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.209904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.210573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.210925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.211201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.217313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:36.217313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.217313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ebaf9-1b99-4c91-8118-7669d9b963d0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.232374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 391/793] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:36.233855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902368f-541f-4911-b881-4e98c5997e54 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.234140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902368f-541f-4911-b881-4e98c5997e54 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.234415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902368f-541f-4911-b881-4e98c5997e54 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.235898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 392/794] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:36.238539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902368f-541f-4911-b881-4e98c5997e54 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.246371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0321f-ec11-40aa-bc4d-0efc893f2bcd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.291212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.292156 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.292469 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.292761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.294264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:36.294962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.296346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fa815-d392-49cf-abaf-4e38bd1dc6f8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.314173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 403/795] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:36.315360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.315649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.315929 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.336525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:36.337756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:36.355149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902368f-541f-4911-b881-4e98c5997e54 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.391308 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.392096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.392375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.392691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.403670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.405278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:36.423332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:36.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:36.425507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:36.425507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:36.425507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:36.425507 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.428488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 393/796] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:36.429568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.432931 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 404/797] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:36.434313 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.456897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.494902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.537501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a678d2-0ec4-480a-bf0f-cb20c3de1fc5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.572162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839832dc-e590-488f-8dc9-c0d333ad17ec None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.573516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.574313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.574579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.574880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.582380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.584031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:36.599842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:36.601044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:36.602038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.605860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 394/798] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:36.607341 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.615253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.616504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.616992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.617473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.618393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:36.618956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.620568 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.633739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 405/799] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:36.634812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.700079 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.718127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4877d-1d89-4605-adc6-0c1d3daa8cd8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.744641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8c231-c7de-4e57-bd00-816fef132728 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.746299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.753845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.759924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.759924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.759924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.759924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.759924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:36.770144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:36.771090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:24:36.771928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.774878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 395/800] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:36.775951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.783117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.783932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.784293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.784704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.785707 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:36.786125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.794330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.812830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 406/801] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:36.813829 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.881278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96e023-a3fc-4f26-8142-f0c13a877706 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.916767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.917565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.917844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.918112 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.921244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41e13-f664-4282-a5fe-7433155435d9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:36.925065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.926492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:36.941006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:36.941951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:36.942853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:36.946921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 396/802] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:36.947878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:36.960577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:36.970295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:36.971713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:36.972203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:36.972810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:36.974239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:36.974773 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:36.976898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:36.984553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 407/803] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:36.985690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.019082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.056490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5558b-d5b9-4c4b-b4bc-76a2d79f7395 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.094475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.095722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.096156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.096608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.100947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca00a0-e4ba-4ee7-857b-aa40cb5fe0aa None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.107474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.109251 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:37.128003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:37.129081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:37.130166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:37.130166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:37.130166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:37.130166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:37.133957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 397/804] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:37.134709 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.138770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.139602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.139888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.140165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.140979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:37.141289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.142706 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e70a2a-0fb8-45c6-93ac-b39ca679d53d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.154589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 408/805] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:37.155793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf4fb-6b1b-4469-a331-3ee6953214c8 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.156076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf4fb-6b1b-4469-a331-3ee6953214c8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.156351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caf4fb-6b1b-4469-a331-3ee6953214c8 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.161435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 409/806] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:37.162178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf4fb-6b1b-4469-a331-3ee6953214c8 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.211004 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.252559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.262004 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f3e26-53d6-4342-9f77-418ef3a71389 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.269279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caf4fb-6b1b-4469-a331-3ee6953214c8 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.300944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.301608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.301892 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.302174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.302874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:37.303184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.304591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.307165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.307827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.308089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.308359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.309094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:37.309930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.315088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 398/807] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:24:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:37.315088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.315314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bedf7-1299-4ada-aaff-0af4d6b7ef87 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.325755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 410/808] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:37.327095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.327383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.327655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.344091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:37.345320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:37.416543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 411/809] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:37.416543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.432849 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d76c-5812-421b-ae34-f7d9e7f492f7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.458828 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.469288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.474726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.474726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.474726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/b55e15e1ac0f4edc972a89f07c7bea18/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.499311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.528385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a998-69b9-4323-96b4-a0bafc481021 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.565943 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.566616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.566899 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.567176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.567928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.569356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.598433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=b55e15e1ac0f4edc972a89f07c7bea18, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.599875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.691541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 412/810] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:24:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:37.692308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.727224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 399/811] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:37 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/b55e15e1ac0f4edc972a89f07c7bea18/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:37.728128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.846139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2fb03-f562-41d6-903d-6b7334be5301 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.846535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b778be-cafc-4610-98ea-5493f49be157 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:37.911524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:37.925488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.926690 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.927173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.927743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.929042 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:37.929919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.930204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.930480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.938107 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:37.939601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:37.941492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-176dace0-31e5-4bf5-9698-542d0349da14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:37.949505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:37.950647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:37.951509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 400/812] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:37.952795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c258d2-aa53-499b-8054-8ac1b0bfef1b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.952795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c258d2-aa53-499b-8054-8ac1b0bfef1b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.953025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c258d2-aa53-499b-8054-8ac1b0bfef1b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.956556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 401/813] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:37.956892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:37.961603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:37.963802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 413/814] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:37.965264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:37.965264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:37.965264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:37.968821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:37.985688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:37.987161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:38.022619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:38.075337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 402/815] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:38.076607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.113791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9dde9f-12e4-46be-8344-c105ab133807 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.162306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.163321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.163680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.164514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.165352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:38.165666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.167099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.180276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 414/816] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:38.181243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.213784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178117-91fb-45d9-a86b-3b9320b41c1a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.268015 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:38.273223 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.274278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.274996 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.275436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.276344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:38.276818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.278856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.293317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 403/817] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:38.294901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.335983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:38.377213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e20c2d-775e-4985-826d-728f9ae1ddfe None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.433501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551f917-d7ca-4442-8994-4f8c5900bef7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.458384 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.459112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.459389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.459663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] PATH_INFO: `/v3/services/network` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.460311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.461706 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:38.484121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:38.485225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:24:38.486052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:38.492955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 415/818] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:38.493701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.513155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.514058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.514337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.514689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/5a6b2fb527f041f7ba3c2447b824141c/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.520383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=5a6b2fb527f041f7ba3c2447b824141c, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.521921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.590228 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 404/819] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:38 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/5a6b2fb527f041f7ba3c2447b824141c/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:24:38.593491 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.642173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc481ff-72c3-4688-be18-efec8d36129a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.672841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:38.756240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.757014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.757298 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.757580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.775121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.778346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:38.803710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:38.804989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:38.806165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:38.806165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:38.806165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:38.806165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:38.806165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 416/820] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:38.811792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.833739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:38.853874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f6ac0-f207-4cb1-9ff5-01089e17a899 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:38.922238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:38.923140 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:38.923596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:38.924020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:38.925908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:38.926474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:38.929605 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:38.942695 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 405/821] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:38.947902 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:38.967055 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305055f-55bf-45fd-b9f7-b78760c0ddbb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.003976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.004929 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.005351 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.005766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.006717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:39.007162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.008694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.021828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 417/822] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:39.026866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:39.053209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:39.131313 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43d3e0-d8d3-42a8-b978-819c01566eac None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.168253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.169454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.169901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.170312 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.178565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.190723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.203657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749fcc7-c001-43ad-8b83-a0e899e14ea8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:39.212023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:39.213219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:39.214407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 418/823] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:39.216863 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:39.280245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.281028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.281380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.281650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.282351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] RBAC: Adding query filter params (type=network) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:39.282648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.284001 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.298315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 406/824] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:39.303657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:39.328501 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:39.374587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:39.407191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabc9ce-8242-4778-836c-e77d668ce473 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.475281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.475953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.477791 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f54b0-334f-493f-9602-eb3d0f96e735 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.479471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.479751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.480608 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:39.480947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.482371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.523083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 419/825] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:24:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:39.525519 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:39.553391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.553969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.554244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.554514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.555264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.557006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.655052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ceb72-95e4-47f7-aca9-a4da1dba9fc6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:39.674842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 407/826] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:24:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:24:39.699030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:39.700616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:39.701079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:39.701555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:39.705962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:39.779877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:39.781453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afbc37-d42f-4576-908c-6e73973eb759 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:39.892850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 420/827] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:24:39.898153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:39.973563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.012735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0b0a5-81ea-4580-b089-be42fc1ba448 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.060090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.060949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.061234 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.061510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.066090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675769-f10c-4726-9461-06e27929294b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.066383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675769-f10c-4726-9461-06e27929294b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.066657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e675769-f10c-4726-9461-06e27929294b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.068022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 421/828] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:40.073162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10869c24-d8da-44d0-ad42-134696765d64 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.073453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10869c24-d8da-44d0-ad42-134696765d64 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.073732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10869c24-d8da-44d0-ad42-134696765d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.078823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.080277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.091108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-10869c24-d8da-44d0-ad42-134696765d64 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:40.092656 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-10869c24-d8da-44d0-ad42-134696765d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:40.101511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:40.102433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:40.103321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:40.103321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:40.103321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:40.103321 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:40.105443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 408/829] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:40.109456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.136543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.194101 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 422/830] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:40.195432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f010-e960-4b3a-9452-21103ff4fd86 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.195724 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f010-e960-4b3a-9452-21103ff4fd86 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.196006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295f010-e960-4b3a-9452-21103ff4fd86 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.201641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 423/831] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:40.206330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.206716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.207053 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.224604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:40.225919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:40.249248 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426debf8-0c20-46b6-b79c-d0355beb4097 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.271073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.282832 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.283517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.283760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.284032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.284829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:40.285144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.286573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.298557 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 409/832] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:40.299328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.304537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 424/833] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:40.305480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.403406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.407846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a48cd4-825e-4f42-9092-f9ce16554900 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.409515 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5423-c6a3-470d-a11a-3c0ed7d97e93 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.446098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.446461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.446846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.447135 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.447233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.447409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.447506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.447758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.454442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.455876 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.458336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:40.466432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:40.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:24:40.468267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:40.470194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:40.471031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:40.471951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 425/834] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:40.473082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.475778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 410/835] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:40.477763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.522900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.574272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321364-2509-4257-9c2a-8c96d603ea02 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.583441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d3537-fb32-46d7-b2de-02c0c172dc4e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.608517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.609318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.609615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.609894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.610552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.611925 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.620136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.620820 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.621100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.621370 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.622133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:40.622431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.623756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:40.624616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:40.625584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:40.626423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 426/836] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:40.628119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.635625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 411/837] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:40.636769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.655239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.735522 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b588-0f2c-4711-8a99-679408bceedd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.748618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f39c1-0b0c-4dff-9858-448b2f11986b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.752056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.774306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.774964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.775249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.775524 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.776301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:40.776662 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.778716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.784715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.785437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.785731 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.786198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.787052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:40.787661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.789041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.798346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 412/838] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:40.798346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.798577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 427/839] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:40.798577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.884504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:40.902097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e11074-36fa-4202-aad8-81a8ddc89348 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.905629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610fd9-d126-4274-b3e3-34661665aedf None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:40.943290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.943912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:40.944434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.944739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.945022 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.945194 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.945309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.945723 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.946681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:40.947252 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.948996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.964441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:40.964441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:40.964741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 428/840] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:40.964741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b36fb3f4-20c6-43d2-a9e7-32790ee69e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:40.978033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:40.979056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:40.980028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:40.980028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:40.980028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:40.980028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:40.980028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 413/841] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:40.981025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f843-a538-4708-91ef-9e5f71639a39 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:40.981311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f843-a538-4708-91ef-9e5f71639a39 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:40.981587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f843-a538-4708-91ef-9e5f71639a39 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:40.983131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 414/842] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:40.986055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f843-a538-4708-91ef-9e5f71639a39 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.015590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.088720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612442f-7c9c-42de-9d75-e9973bee70a3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.110242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f843-a538-4708-91ef-9e5f71639a39 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.129605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.130272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.130561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.131198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.131544 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:41.131850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.133364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dbe66-fec2-437b-a0f0-1d6717d5da75 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.139051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 429/843] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:41.140245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.140635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.140916 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.153903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.154624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.154887 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.155157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.155954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:41.156263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.157698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.158491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:41.159729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:41.162783 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.176439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 415/844] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:41.179109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.249557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 430/845] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:41.273966 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.288793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.312030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a113-27b6-4443-aeb5-8ac3eaf56b90 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.354333 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.355543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.356718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.357066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.366584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.368127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:41.388573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:41.389566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:41.390517 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 416/846] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:41.392819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af438-1612-4135-a7f0-24176f37543c None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.396628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.431658 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.433289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.433772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.434818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.443086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.447362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:41.456178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:41.458596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:24:41.459475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:41.465716 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 431/847] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:41.466993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.521924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763eb77d-301e-4f46-a714-dac1f598497f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.557921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.558615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.558960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.559729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.560597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:41.560904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.562325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.571570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.585069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 417/848] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:41.585243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5469af-1040-4ece-b8c6-4bf58972bdb0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.586960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.623978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.625129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.625646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.626128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.627074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:41.627601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.629211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.640309 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 432/849] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:41.649822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.691268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310444fe-8ff1-4c59-8562-cadf4eb842bb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.724787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.726322 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.727048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.727447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.727819 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.770730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0f4918-b794-4113-83e7-63ee1a349032 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.809142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:41.809932 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:41.810281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:41.810630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:41.812577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:41.817037 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.818632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.824040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:41.825645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:41.845488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:41.846400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:41.847295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:41.847295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:41.847295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:41.847295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:41.849712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 433/850] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:41.854867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.936093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 418/851] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:24:41.937343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:41.970700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123749e-3b84-4329-b55a-898851ccc040 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:41.984772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.006989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.007650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.008174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.008484 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.009611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:42.009938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.011765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.032818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 434/852] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:42.036422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.059230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.062986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e9e73-ba6f-4e24-9748-4a6d45e7c9a3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.098446 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.099238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.099522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.099796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.110154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.112568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:42.131675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:42.132771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:42.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:42.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:42.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:42.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:42.138848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 419/853] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:42.140149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.151128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52141a9a-8c05-42a5-ba8f-0942399805f4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.192655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.193779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.194276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.194730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.204123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.206775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:42.223475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:42.224466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:24:42.225419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:42.232563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 435/854] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:42.233653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.244926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d6d7-2110-49a6-abf7-ebd6f6972bb2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.269998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.281641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.282307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.282596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.282862 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.285459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:42.285459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.285459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.303256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 420/855] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:42.305444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.319060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.351720 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4421ff-a663-4f6c-8a5d-b6ef80567d10 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.388813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.389912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.390393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.390861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.391895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:42.392570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.394341 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.412530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0e829-5ff5-46b2-b29f-a8ea8b308edc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.418213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 436/856] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:42.419310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.448241 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.449169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.449514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.450283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.457689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.459095 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:42.473916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:42.474822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:42.475735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:42.479810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 421/857] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:42.481180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.519461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.530119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178f94d-3545-44a9-98b8-2199a2e93ecd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.555341 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.567811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.568848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.569383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.569856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.589302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ee865-b131-4132-aa89-036fc2882448 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.626420 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.627087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.627373 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.627653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.628455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:42.628778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.630307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.644559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.646323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.648485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 422/858] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:42.650059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.741018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.757555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 437/859] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:24:42.758200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c3b4f-62b1-4c24-bec2-355f9d74690e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.759011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:42.790782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:42.799108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.799942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.800562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.802100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.802100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=b55e15e1ac0f4edc972a89f07c7bea18) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:42.802597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.804259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.820827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 423/860] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/role_assignments?user.id=b55e15e1ac0f4edc972a89f07c7bea18&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:42.879248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e7ef5-f7a1-4788-b89d-7dec17e16100 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:42.917500 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:42.919179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:42.919639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:42.920084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:42.931827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:42.936629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:42.953969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:42.955211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:42.956318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:42.956318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:42.956318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:42.956318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:42.958489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 438/861] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:42.964526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.075900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538523c-8186-4be9-a80d-f5fc1be14ec2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.118130 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.118795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.119076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.119348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.120076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:43.120381 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.122375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b3a00-8bc6-4f18-901c-117ba084466d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.135943 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 424/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:43.141619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.144766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cc75-fd1f-4619-9e99-2f161af2de22 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.145068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cc75-fd1f-4619-9e99-2f161af2de22 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.145440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900cc75-fd1f-4619-9e99-2f161af2de22 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.147360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 425/863] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:43.151893 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c0a2-2113-419d-87b7-778d30810c81 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.152180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c0a2-2113-419d-87b7-778d30810c81 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.153018 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c0a2-2113-419d-87b7-778d30810c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8492c0a2-2113-419d-87b7-778d30810c81 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:43.171293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8492c0a2-2113-419d-87b7-778d30810c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:43.201197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.225965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.243724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 426/864] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:43.245216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679adb9-90fa-4771-af67-01e8a4ac234c None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.245529 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679adb9-90fa-4771-af67-01e8a4ac234c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.245807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679adb9-90fa-4771-af67-01e8a4ac234c None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.247792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 427/865] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:43.258224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.258514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.258786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.271733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d069a4-15bf-4de6-8149-f0e68ab3f5e1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.278471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:43.280815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:43.310599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.311840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.312127 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.312676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.320554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.322424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:43.337324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:43.338207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:43.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 439/866] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:43.339563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.360456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 428/867] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:43.360456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.456548 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a930-206a-4670-a5e9-56ddcfec985b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.458456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.464542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff051f5-455c-4f6b-a033-6f5c5c50fd75 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.480093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.492124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.492960 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.493243 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.493518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.494160 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.495513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.502428 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.503371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.503858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.504312 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.505347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:43.505883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.507585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:43.508014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:43.509003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:43.515343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 440/868] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:43.516241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 429/869] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:43.529602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.619561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63b1a7-b82d-4372-94da-60ae3a04d3a6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.631153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58efda-4a82-43c6-9c4d-00e31c4995c2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.656938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.657608 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.657892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.658228 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.658949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.660318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.667381 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.668044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.668874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.669152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.669851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:43.670155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.671504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.675914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 430/870] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:43.676696 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.715629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.744769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 441/871] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:43 2022] POST /identity/v3/services => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:43.746059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:43.783047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846c1e-dcda-42f5-9bda-2bcdff80d40c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.786737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:43.832574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.833245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.833523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.833792 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.838794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=5a6b2fb527f041f7ba3c2447b824141c) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:43.838794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.838794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722c60b-611f-45ba-8be9-4c841cb17c5e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.846356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 431/872] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/role_assignments?user.id=5a6b2fb527f041f7ba3c2447b824141c&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:43.886634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997f4e5-3fff-4df4-977c-0bfa39ce7bb4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:43.929049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:43.929743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:43.930024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:43.930300 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:43.931020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:43.931325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:43.932923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eefa5b-9f70-45f0-b51d-7dd840b38d96 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:43.938881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 442/873] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:45.007068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ca9f-0252-404f-8e57-0a1aba148ad1 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.007595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ca9f-0252-404f-8e57-0a1aba148ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.007595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6ca9f-0252-404f-8e57-0a1aba148ad1 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.009345 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 432/874] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:45.014973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.015463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.015562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.032605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:45.033771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:45.104345 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 443/875] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:45.127360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6ca9f-0252-404f-8e57-0a1aba148ad1 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:45.224479 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:45.229233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6ca9f-0252-404f-8e57-0a1aba148ad1 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:45.262748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba802-2445-4817-b158-1159570271ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:45.263484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba802-2445-4817-b158-1159570271ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.263768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba802-2445-4817-b158-1159570271ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.264044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dba802-2445-4817-b158-1159570271ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.274760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dba802-2445-4817-b158-1159570271ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-14dba802-2445-4817-b158-1159570271ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:45.283713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:45.285739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:45.286918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 433/876] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:45.297494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:45.318260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:45.401283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d6de4-60e0-4dd8-bea1-df00f095496d None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:45.436679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:45.437346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.437629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.437906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.438647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:45.438953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:45.440319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:45.449002 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 444/877] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:45.461377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba802-2445-4817-b158-1159570271ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:45.567962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dba802-2445-4817-b158-1159570271ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:45.602681 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:45.603466 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.603751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.604020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.614419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:45.616103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:45.634268 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:45.636346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:45.638979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:45.638979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:45.638979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:45.638979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:45.638979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 434/878] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:45.645657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:45.729675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:45.753092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f6f64-0292-4434-8cd2-0e1f9f8d99b5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:45.789036 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:45.789699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.789983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.790260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.790980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:45.791286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:45.792722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447470b-825f-40d2-ad6a-5a47d4e13ead None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:45.805634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 445/879] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:45.811383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:45.829067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:45.922157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729f8a-17a4-4cd8-8c1a-4bb8841e995c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:45.957330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:45.958208 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.958488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.958767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.958933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450089f3-ae1b-4c80-b377-19b8760da2cd None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.959086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450089f3-ae1b-4c80-b377-19b8760da2cd None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.959367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450089f3-ae1b-4c80-b377-19b8760da2cd None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.961046 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 446/880] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:45.966053 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171416bb-661d-4ae8-8891-420e61d538d6 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.966336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171416bb-661d-4ae8-8891-420e61d538d6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.966611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171416bb-661d-4ae8-8891-420e61d538d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.968032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:45.969509 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:45.984583 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-171416bb-661d-4ae8-8891-420e61d538d6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:45.985750 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-171416bb-661d-4ae8-8891-420e61d538d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9525956c-abb7-4656-b7ea-44863bf72cd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:45.986648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:45.988982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 435/881] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7a2d-36b0-4c88-961f-4adcfc8ee7fa None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:45.991520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7a2d-36b0-4c88-961f-4adcfc8ee7fa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:45.994889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c7a2d-36b0-4c88-961f-4adcfc8ee7fa None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:45.994889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 436/882] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:45.994889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7a2d-36b0-4c88-961f-4adcfc8ee7fa None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.057396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 447/883] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:46.058701 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61511d-f38e-4e86-97c3-c70619f61212 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.059488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61511d-f38e-4e86-97c3-c70619f61212 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.059769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61511d-f38e-4e86-97c3-c70619f61212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.065776 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.075812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7a61511d-f38e-4e86-97c3-c70619f61212 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:46.077096 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7a61511d-f38e-4e86-97c3-c70619f61212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:46.098924 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c7a2d-36b0-4c88-961f-4adcfc8ee7fa None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.132657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.133364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.133972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.134800 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:46.135108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.136559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e27f-6ad8-4698-a066-139b09ba8dc5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.142646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 448/884] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:46.144143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59d4-5da5-4ac4-a32e-e6881728f964 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.144452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59d4-5da5-4ac4-a32e-e6881728f964 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.144738 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e59d4-5da5-4ac4-a32e-e6881728f964 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.145967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 449/885] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:46.146807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e59d4-5da5-4ac4-a32e-e6881728f964 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.149393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.158384 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 437/886] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:46.159700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.159993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.160269 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.177046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:46.178225 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:46.244205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 438/887] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:46.245076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.258765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e59d4-5da5-4ac4-a32e-e6881728f964 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.294792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.295585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.295865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.296137 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.296821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.298188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.302430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:46.309828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:46.314659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.315486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 450/888] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:46.316292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.346101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13676c8-4a5c-4b48-9190-3df35d0f6f28 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.375124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.379340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.379977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.380255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.380559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.409950 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bc91e-80d4-40bc-9673-44ae8b405dfb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.442286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.443079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.443362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.443646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.445014 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.445677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.446430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:46.457489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:46.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.459350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 451/889] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:46.460162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.509622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.552157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 439/890] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:24:46.553050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.557269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d59b2-d1b1-46ce-a2f8-ac504c0a3776 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.591303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.597077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.597768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.598052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.598329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.599141 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.600511 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.649277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411f798-f857-46cc-8686-7ce038f912c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.684131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.684891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.685179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.685462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.686204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:46.686544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.688087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.693108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 440/891] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:46.693983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.720465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 452/892] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:46 2022] POST /identity/v3/services => generated 269 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:46.720465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.721608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.804786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff995-21ce-445c-b291-280ffa356eb6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.839575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeec3e3-739d-4d10-bf35-bb8eaa828217 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:46.846353 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.850409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.850409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.850409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.850409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:46.850409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.851211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.862784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 441/893] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:46.862784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.882623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:46.883681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:46.883964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:46.884236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:46.896376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:46.898102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:46.916087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:46.917201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 453/894] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:46.918208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:46.960569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.968121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:46.975235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62a39-cf4e-415a-b5a8-4777aed28424 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.010300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.010961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.011244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.011518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.012863 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.013169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.014531 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.019440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 442/895] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:47.020218 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.036789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784180b-e01c-48f3-b47f-e6d983803872 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.074801 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.075603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.075890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.076169 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.076909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.077275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.078655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.083662 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 454/896] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:47.092815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.138660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8c5d2-be89-4dcc-a2c3-db13f0b15027 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.178343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.178933 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.179222 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.179502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.180243 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.184125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.185649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.207504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 443/897] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:47.213412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.229778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722b66-13a0-4f47-ae9e-a338250d87f1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.232038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:47.234058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:47.272553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.273632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.274084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.275393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.276339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] RBAC: Adding query filter params (interface=public, service_id=c027dad789034b3e8f0fee170ac18db0, region_id=RegionOne) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.276886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.278514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.284428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 455/898] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/endpoints?service_id=c027dad789034b3e8f0fee170ac18db0&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:47.291105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.353415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cdd0f7-ea2d-4e00-b8f8-a4d8f7730e9d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.389458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.390260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.390548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.390826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.397921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.399547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.412513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577d20b-ca46-457d-ad3f-707a3f33e570 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:47.413965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:47.414879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:47.415790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:47.420644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 444/899] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:47.421505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.457537 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.458123 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.458405 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.458688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.459364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.460761 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.472504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 456/900] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 22:24:47.507324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:47.540707 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f43be-cef0-4485-9cd3-e1a61b90cd2f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.580664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.581340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.581825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.582107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.582910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.584838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457fe15-1381-4cbf-b633-95b711c929e1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.598853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 445/901] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:47.604905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:47.640133 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:47.712367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d8084-a756-4719-b94e-e8ee092ed384 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:47.754558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:47.755615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:47.756101 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:47.756623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:47.757672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] RBAC: Adding query filter params (role.id=e81817fdd33a44c0b6121a23432bcb5f, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=b55e15e1ac0f4edc972a89f07c7bea18) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:47.758193 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:47.759851 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3220e16-68c8-4436-91ac-6685625217e8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:47.766566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 457/902] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:47 2022] GET /identity/v3/role_assignments?user.id=b55e15e1ac0f4edc972a89f07c7bea18&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=e81817fdd33a44c0b6121a23432bcb5f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:48.802458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac17d3-1eda-49aa-8b33-60eecbb10aca None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:48.803423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac17d3-1eda-49aa-8b33-60eecbb10aca None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:48.803963 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac17d3-1eda-49aa-8b33-60eecbb10aca None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:48.805788 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 446/903] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:48.812062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:48.816035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:48.816035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:48.830953 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:48.832327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:48.905851 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 458/904] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:48.930028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac17d3-1eda-49aa-8b33-60eecbb10aca None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.037563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac17d3-1eda-49aa-8b33-60eecbb10aca None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.067041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.073102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.073907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.074252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.074525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.075167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.076538 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-44c76b16-a9ba-472e-a6f8-f81943ef8b74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:49.088914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:49.090124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.090977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 447/905] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:24:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:49.099196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.126438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.191337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607626c7-8aa0-4351-9a3c-706279badefb None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.191619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607626c7-8aa0-4351-9a3c-706279badefb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.192096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607626c7-8aa0-4351-9a3c-706279badefb None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.193786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 448/906] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:49.200241 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.200926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.201831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.221872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b52d-1801-4bbd-a97a-1874299edada None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.223336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:49.225714 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:49.266991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.267653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.267935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.268210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.268948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:49.269254 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.270633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.275860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 459/907] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:49.281396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.324763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 449/908] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:49.350008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.396743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.413121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883ac69-9300-4627-bf55-bf7a9467a5ec None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.460128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc9a51-72b8-4d00-a1b0-74ba839ae44a None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.462638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.463304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.463583 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.463855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.464623 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:49.464931 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.466284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.476456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 460/909] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:49.477617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.493124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.507789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.508553 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.508833 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.509553 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.510456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.513298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bc0b2-5aad-4256-9026-75e92a794a33 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.582915 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e8931-b025-4147-be38-cc4ecd7390ac None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.600463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 450/910] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:49 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:24:49.637708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.638670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.639159 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.639588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.640659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] RBAC: Adding query filter params (interface=public, service_id=86f4a278e69143d98e973af27ae369de, region_id=RegionOne) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:49.641196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.642133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e84e-1c77-4635-8355-562a1322b23d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.642666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e84e-1c77-4635-8355-562a1322b23d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.642794 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.643265 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700e84e-1c77-4635-8355-562a1322b23d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.644907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 451/911] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:49.649784 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 461/912] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/endpoints?service_id=86f4a278e69143d98e973af27ae369de&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:49.651115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.651618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.652166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.656112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.671117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:49.672760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:49.674011 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.756553 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 452/913] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:49.773635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.795040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60e1f2-f0bc-4f91-a438-30d2680eb25c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.836677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.837570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.837857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.838139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.839077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.841199 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb1425-589f-48ca-aa6a-09d68ca09322 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.850247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 462/914] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:24:49.860493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486102-a1c4-4606-b6c6-c02bfa2916e4 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.860493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486102-a1c4-4606-b6c6-c02bfa2916e4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.860493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84486102-a1c4-4606-b6c6-c02bfa2916e4 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.860493 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 463/915] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:49.862917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.863239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.863583 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.890436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:49.891760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:49.891967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f841d-0609-45a3-aef8-933c642ce5bf None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:49.910786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:49.938482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:49.939387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:49.939680 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:49.939964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:49.940749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:49.942347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:49.958754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:49.959895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:49.966109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 453/916] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:49.970146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:49.992509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 464/917] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:50.016358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.025793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:50.098629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1aad3-d639-4626-9f17-79869400de0b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.134264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a9e6d-bca4-432b-80ae-4363b566f4f8 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.144197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.144965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.145317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.145659 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.146881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:50.147259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.149375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.155040 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 454/918] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:50.160721 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.176190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.177173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.177456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.177731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.198269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:50.207705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:50.208704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:50.209558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 465/919] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:50.215555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.224235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:50.293680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:50.306541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cee79-0dd9-4a56-9c38-ef7a2849449d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.335130 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab8efb-9a28-44d8-8433-206a9a8f294d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.350821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.351876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.352161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.352455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.353306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:50.353747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.355876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.363409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 455/920] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:50.372432 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.379830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.380683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.381079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.381505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.382328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:50.382731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.384284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.393813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 466/921] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:50.398912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.488607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb611ac8-7ee7-4750-a62c-5f1c1201a431 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.497149 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:50.521049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca8953-b8b4-48f0-a2e4-10deec9099ac None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.535295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.536470 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.536873 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.537292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.538048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.539982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.549730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:50.558287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.560538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.560538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.560538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.570766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.572350 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:50.590190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:50.591149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:50.592565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:50.592565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:50.592565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:50.592565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:50.592565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 467/922] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:50.602062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.621453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 456/923] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:24:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:50.716490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c930abe-3493-446c-886e-315498b1d030 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.759669 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.760334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.760648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.760923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.761684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:50.761987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.763406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.777577 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 468/924] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:50.783546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.888907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a7117-4c7e-4ba0-abb1-43dbabb93ec5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:50.924385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:50.925215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:50.925496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:50.925767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:50.933737 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:50.935155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:50.949504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:50.950488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:50.951439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 457/925] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:50.958281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:50.994322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.059660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b08cda-01ad-4b59-95a1-be2b1b09d496 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.102308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.102983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.103266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.103542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.104373 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:51.104715 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:51.106143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:51.124475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 469/926] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:51.133484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.161449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.248905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f53e95-4310-4f37-aecd-f5cd279353bb None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.283128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.283910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.284190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.284487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.295098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:51.296550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:51.313391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:51.314284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:51.315188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:51.315188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:51.315188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:51.315188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:51.315188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 458/927] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:51.320599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.416222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.423406 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc3d28-cba4-4e66-a1ce-432b2e9c9255 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.458249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.458923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.459698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.459979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.460728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:51.461039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:51.462409 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:51.475149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 470/928] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:51.480889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.560085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.590058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487dec41-ffa1-4b49-b6a4-be988b86e8fd None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.630295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.631142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.631433 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.631709 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.639275 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:51.640758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b433d569-da12-4b9e-b340-c6ba83842e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:51.655143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:51.656041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:51.656965 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 459/929] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:51.665657 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.711287 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93ce2-eea2-403b-84e0-8f6aeff6217d None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.711597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93ce2-eea2-403b-84e0-8f6aeff6217d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.711777 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c93ce2-eea2-403b-84e0-8f6aeff6217d None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.713168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 460/930] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:51.718195 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.718674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.719147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.737482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:51.738981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:51.786541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc9128-71e5-44d4-8f5f-cd5134f589f2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.820783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 461/931] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:51.829263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.829930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.830215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.830491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.831280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:51.831589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:51.833093 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:51.837240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.848265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 471/932] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:51.853142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:51.899422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.905271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:51.957814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8112b5-86e6-4d1b-bcb2-58b6970daa92 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.981764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10541ce-7678-4f3c-b3d3-3a19d1571535 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:51.997072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:51.998131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:51.998526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:51.998893 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:51.999642 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.001121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:52.013747 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:52.014839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:52.015677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 462/933] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:52.022387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.023162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.024134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.024513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.024872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/b55e15e1ac0f4edc972a89f07c7bea18/roles/e81817fdd33a44c0b6121a23432bcb5f` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.028234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=b55e15e1ac0f4edc972a89f07c7bea18, role_id=e81817fdd33a44c0b6121a23432bcb5f)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.029771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c6d4f-b27e-4cd5-94ee-80f0239652b6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.102774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 472/934] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:24:51 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/b55e15e1ac0f4edc972a89f07c7bea18/roles/e81817fdd33a44c0b6121a23432bcb5f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:24:52.114292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39be64-7bfd-4805-ae10-d788ea20cc08 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.114589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39be64-7bfd-4805-ae10-d788ea20cc08 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.114967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39be64-7bfd-4805-ae10-d788ea20cc08 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.116860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 473/935] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:52 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:52.123262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.129554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.129554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.142330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:52.143628 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:52.147885 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3586883-83b3-486b-ae24-39d55ae439ce None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.195787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.206154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.207121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.207465 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.208024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.208891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:52.209267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.210774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.217215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 463/936] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:52.223219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.243697 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 474/937] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:52.261784 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.265119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.354311 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ef438-8ad8-4d03-9d31-8c7ecc9667a5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.382885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eadec2-31f5-427b-956e-fe1b7b92e84b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.400961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.401631 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.402449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.402734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.403440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:52.404285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.405973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.414087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 464/938] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:52.420641 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.427624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.428471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.428759 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.429037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.429699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.431601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:52.448704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:52.449748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:24:52.450602 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:52.451418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 475/939] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:52.457097 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.486541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.539274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fbe8-7051-4d8d-9102-507a83fbfc5d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.540785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.575729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.576529 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.576881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.577034 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a2838-d226-4553-b669-f17e0336da31 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.577298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.578327 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] RBAC: Adding query filter params (interface=public, service_id=b472c7a977a54ce38526e0be5325d805, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:52.578704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.580784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.591575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 465/940] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/endpoints?service_id=b472c7a977a54ce38526e0be5325d805&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:52.592732 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.615452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.616479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.616766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.617043 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.618378 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:52.618689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.620859 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.632496 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 476/941] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:52.635012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.708613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96367353-0f9b-41f9-ae8c-9d2536032f35 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.732365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.748596 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.749262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.749822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.750775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.752582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.764564 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 466/942] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 22:24:52.777798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed52f2-b9dd-41f7-a3ac-1bc0d56408d1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.811383 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:52.816927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.826709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf587c-10b0-4bf2-9a63-ab5236fa182f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:52.832591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 477/943] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:52.834860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:52.929760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abfdc-8f6c-4d2d-8a40-97b400cf7fdd None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.930089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abfdc-8f6c-4d2d-8a40-97b400cf7fdd None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.930314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0abfdc-8f6c-4d2d-8a40-97b400cf7fdd None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.931906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 478/944] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:52.937575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.937858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.938140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.953488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e013b-5883-4ede-be66-f679be002ba9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:52.956908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:52.958104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:52.993189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:52.993847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:52.994126 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:52.994395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:52.995139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:52.997056 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:53.050813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 479/945] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:53.070851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 467/946] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:24:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:53.080375 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:53.204268 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a479d-11a2-4fc6-8e09-45a3610bf2be None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:53.233907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:53.255575 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:53.256262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:53.256580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:53.256855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:53.257585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:53.259083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:53.260683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: WARNING keystone.server.flask.common [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 22:24:53.307062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.sql.core [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:24:53.307062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 22:24:53.307062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [parameters: {'id': 'bbcf86ab3de74852b4b22af4b28682f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 22:24:53.307062 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80047) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcf86ab3de74852b4b22af4b28682f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcf86ab3de74852b4b22af4b28682f8. Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:53.315135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 22:24:53.315964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application yield resource Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise self.value Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application session.commit() Jun 29 22:24:53.317428 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:24:53.318552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:24:53.319479 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:53.320281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [parameters: {'id': 'bbcf86ab3de74852b4b22af4b28682f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:53.323048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:53.325049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcf86ab3de74852b4b22af4b28682f8. Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:53.327419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 480/947] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 22:24:53 2022] POST /identity/v3/projects => generated 262 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:53.328878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:53.366668 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:53.425647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f6c1b-58dc-4f1e-925f-332dad4198b0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:53.459468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:53.460266 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:53.460589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:53.461030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:53.468387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:53.469890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-4e1b5cf3-4184-4c91-872d-2c92c108bc72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:53.485217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:53.487360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:53.489637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 468/948] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:53.492847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:53.597605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ffb30-f854-4ec0-9c13-cd5b8554762c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:53.633514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:53.634165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:53.634445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:53.634717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:53.635463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:53.635764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:53.637463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bdc25-9e24-48ff-95d3-67a354f25903 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:53.658842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 481/949] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:54.192635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1acc74-426b-4a13-97b9-7b321fda6174 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.193047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1acc74-426b-4a13-97b9-7b321fda6174 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.193238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1acc74-426b-4a13-97b9-7b321fda6174 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.194790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 469/950] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:54.200684 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.201087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.201257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.218695 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:54.220255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:54.249625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:54.288844 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 482/951] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:54.312657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1acc74-426b-4a13-97b9-7b321fda6174 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:54.418616 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:54.425712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1acc74-426b-4a13-97b9-7b321fda6174 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:54.462163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:54.463305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.463788 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.464285 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.475379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:24:54.483847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:54.484957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:24:54.485851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:54.488648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 470/952] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:24:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:54.497377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:54.594368 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2f335-cc5f-4302-973e-a94f2e8b3afc None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:54.629424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:54.630094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.630377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.630653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.631394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:54.631700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:54.633099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:54.643944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 483/953] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:24:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:54.649418 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:54.755693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882be80f-8dfa-4a63-8846-002b68702512 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:54.791048 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:54.791838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.792121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.793015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.804512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:54.805959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-77bc8970-6716-44c6-814a-b6ddf95cedc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:54.823871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:54.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:54.827090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:54.827090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:54.827090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:54.827090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:54.827090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 471/954] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:54.831083 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:54.865814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:54.942244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecd6ea-2b3a-4307-8c30-f73a080801dd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:54.976139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:54.976946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.977180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.977463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.978318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:54.978624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:54.978855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0b19-4900-4e96-a7b5-8283e29d8603 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.979147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0b19-4900-4e96-a7b5-8283e29d8603 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.979429 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a0b19-4900-4e96-a7b5-8283e29d8603 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.980779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:54.981664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 472/955] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:54.988967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:54.989541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:54.990019 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:54.994275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 484/956] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:55.001420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.008833 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:55.010374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:55.018607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.092681 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 473/957] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:55.099756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.109584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33bb4-d570-4441-aa41-90de7dfa56f2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.111342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.147331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.148432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.148849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.149402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.157884 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.159495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:55.175979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:55.177172 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:24:55.178138 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:55.178717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 485/958] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:55.183886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.227469 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5b04a-a124-44ff-857c-5747fe77891f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.266956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.268041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.268533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.268985 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.269904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.271619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:55.285436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:55.286617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:55.287497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.295951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 474/959] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:24:55.297232 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.307736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.310885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed1a1e-26cb-4e79-a547-26f00685567f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.353854 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.354539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.354817 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.355690 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.356547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:55.356860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.358271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd489b-024e-4a07-8d20-02e8a904c4a5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.375389 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 486/960] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:55.376699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d2cf-5510-4061-b2f4-706f72334a83 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.376983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d2cf-5510-4061-b2f4-706f72334a83 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.377261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d2cf-5510-4061-b2f4-706f72334a83 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.378733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 487/961] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:55.381065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d2cf-5510-4061-b2f4-706f72334a83 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.393696 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.409062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8595f8-b001-466f-b89e-2a203349e7df None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.447058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.448013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.448454 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.448770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.449471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:55.449774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.451123 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31191426-097a-4734-b2a2-7fb4899928b0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.455784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 475/962] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:55.456969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.457253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.457525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.474583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:55.475740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:55.499262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d2cf-5510-4061-b2f4-706f72334a83 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.536278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.536869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.537153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.537679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.541511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.554821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 476/963] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:55.554821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.613365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.614910 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.625206 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.660754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cc2e7-e52f-407c-b649-c0572c4983c9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.697654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.698474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.699276 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.699555 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.700257 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:55.700592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.702050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.707041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 477/964] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:55.707812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.720084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 488/965] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:24:55.721207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.780622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.822197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba56ca5-453f-4cdb-9c65-c9e7616b255f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.826057 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648d6fa-fd9f-4d7e-9afc-663d914ade82 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:55.835237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:55.856749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.857532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.857809 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.858084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.858841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.859483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:55.860155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.860259 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.860459 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.860736 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.861457 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:55.862811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b05196-8cb4-4a5b-9697-9f233b28e17c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:55.872595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:55.873812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:55.875038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 478/966] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:55.876001 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.950975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 489/967] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:24:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:24:55.952414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b667c-b0f8-4f83-9845-17f1850f6eca None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:55.952827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b667c-b0f8-4f83-9845-17f1850f6eca None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:55.953206 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b667c-b0f8-4f83-9845-17f1850f6eca None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:55.956450 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 490/968] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:55.956450 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b667c-b0f8-4f83-9845-17f1850f6eca None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:55.975623 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ea3a-73cf-4f7e-a27a-85d3d957faf0 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.006844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.024622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.025584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.025969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.026343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.043418 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.045908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a4d3f5a5-cf29-4b37-b105-507ad99e2e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:24:56.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:56.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:56.072101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:24:56.072101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:24:56.072101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:24:56.072101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:56.078518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 479/969] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:56.078518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.078518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.078518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.080787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b667c-b0f8-4f83-9845-17f1850f6eca None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.096413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:56.097782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:56.123436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.124100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.124446 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.124693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.125402 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.125711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.127091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.134425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 491/970] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:56.134880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.164696 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.172572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 480/971] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:56.172572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.258324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57981b2e-8925-401b-a1c3-e0c1f7f6cd3c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.283503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945163e-78c1-46b9-9dfc-d0d072a39a57 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.292181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.296582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.297366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.297704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.298035 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.298820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.299191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.300654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.317016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 492/972] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:56.317016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.328470 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.329438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.329734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.330440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.331488 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.331863 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.333478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.348550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 481/973] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:56.348550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.418914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.433276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7d09b-8750-4391-970c-a2384c9fea41 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.468198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17754b1-ab57-43c2-a92d-87dfc50c9ef4 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.484182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.484898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.485443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.485722 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.486425 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.488449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.507585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.509103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.509388 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.509660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.518187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.520288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:24:56.535344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:56.536319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:24:56.537306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:24:56.537743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.sql.core [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:24:56.537743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 22:24:56.537743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [parameters: {'user_id': '9e156104f6634fe3b86b21f82800c322', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 22:24:56.537743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80047) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:24:56.537994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 482/974] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:56.543182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:56.544237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application yield resource Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise self.value Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application session.commit() Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:24:56.545437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:24:56.546625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:24:56.547799 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application result.read() Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:24:56.549466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [parameters: {'user_id': '9e156104f6634fe3b86b21f82800c322', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:56.551756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 22:24:56.553729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.556142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 493/975] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:24:56 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:56.557118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.557279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.591013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.674555 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1447-fb1a-4ce0-a150-91453f0048f8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.680311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dca16-e04d-49db-9c3c-5b1d85308633 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.714295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.715437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.715940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.716510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.717604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.718156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.719846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.721861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.722677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.722956 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.723229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.732234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.734045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.735219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 483/976] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:56.741057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:24:56.751100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:56.752063 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:56.753767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 494/977] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:56.757734 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:56.771543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.858746 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a44ef3-4718-47ab-bdbc-de60d021e277 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.871246 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:56.884669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e051a49-4519-4153-8c46-735793b52f09 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:56.897132 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.897882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.898244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.898721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.899481 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.899856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.901435 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361b76-e367-4948-a3e0-fed825029a49 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.935052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:56.936094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:56.936606 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:56.937611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:56.938926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] RBAC: Adding query filter params (role.id=e81817fdd33a44c0b6121a23432bcb5f, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=b55e15e1ac0f4edc972a89f07c7bea18) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:56.939435 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:56.941296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21b522-e274-4f3e-9b33-35e803433d44 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:56.948386 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 484/979] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/role_assignments?user.id=b55e15e1ac0f4edc972a89f07c7bea18&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=e81817fdd33a44c0b6121a23432bcb5f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:56.949141 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 495/979] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:24:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:58.034353 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30fa99-7e66-46fa-b910-2c2fd594b3a0 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.034973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30fa99-7e66-46fa-b910-2c2fd594b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.034973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30fa99-7e66-46fa-b910-2c2fd594b3a0 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.036647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 496/980] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:58.041577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.042004 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.042670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.060503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:58.061678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:58.136699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 485/981] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:58.156064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30fa99-7e66-46fa-b910-2c2fd594b3a0 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.231398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:58.265180 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30fa99-7e66-46fa-b910-2c2fd594b3a0 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.300012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.300892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.301276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.301669 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.302423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.303875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bb6bf2ae-d9a1-42c7-ba7d-5de0e3bf4bc9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:58.315847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:58.317075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:24:58.318108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:58.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 497/982] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:24:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:58.326439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.409451 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bf5-8fce-4863-8965-8c4cf5a57b2f None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.409891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bf5-8fce-4863-8965-8c4cf5a57b2f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.410265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89066bf5-8fce-4863-8965-8c4cf5a57b2f None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.410734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:58.411998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 498/983] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:24:58.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.417146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.425251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.428590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c240b45-5e10-4ed9-a8f0-fa239feeac1b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.435242 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:58.436763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:58.464752 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.465500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.465853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.466191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.466954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:58.467324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.468771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.473497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 486/984] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:58.480769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.520742 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 499/985] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:24:58.534550 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.585109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232fc3-4943-4eaf-94d4-3b301bbdc703 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.599638 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:58.620877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.621674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.622050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.622417 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.623224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:58.623619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.625261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.635076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 487/986] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:24:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:24:58.636618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.645095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c797-59be-4d72-ac45-e3be02f8d4ba None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.652744 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:58.680166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.681094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.681377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.681654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.682371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.683772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077b6b0-de1f-4f45-8e4f-3aa9f6d1e994 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.737661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890edf0-c667-4e0f-91cb-c47e478cb45d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.771211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.771856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.772134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.772425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.773223 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] RBAC: Adding query filter params (interface=admin, service_id=b472c7a977a54ce38526e0be5325d805, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:58.773535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.774907 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.781012 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 488/987] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Jun 29 22:24:58 2022] GET /identity/v3/endpoints?service_id=b472c7a977a54ce38526e0be5325d805&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:58.786271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:58.794836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 500/988] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:24:58 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:24:58.872320 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:58.897054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530b1b8-f063-4ca5-8853-b38a115af43d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:58.942164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:58.942546 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:58.942894 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:58.943233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:58.943976 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:58.945422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc050d-4c20-4c4d-9184-4480b7510034 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:58.952649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 489/989] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:24:58 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 22:24:59.047833 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a333cb-305f-4e32-bd6a-ccc647828ccb None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:59.048356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a333cb-305f-4e32-bd6a-ccc647828ccb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:59.048356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a333cb-305f-4e32-bd6a-ccc647828ccb None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:59.049972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 501/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:24:59.055369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:59.055848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:59.055923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:59.074866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:24:59.076082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:24:59.148798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 490/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:24:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:24:59.171681 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a333cb-305f-4e32-bd6a-ccc647828ccb None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:59.280366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a333cb-305f-4e32-bd6a-ccc647828ccb None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:59.303685 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:59.316393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:59.317218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:59.317504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:59.320396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] PATH_INFO: `/v3/services/image` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:59.320396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:59.320396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:24:59.331713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:24:59.332961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:24:59.333820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 502/992] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:24:59 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:24:59.340669 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:59.406897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:24:59.442264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f91932-73e2-4264-af2a-fa1b5ad11303 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:59.476496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:59.477157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:59.477438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:59.477712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:59.478404 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] RBAC: Adding query filter params (name=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:59.478703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:59.480604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068cbdb-0f36-428d-8e35-d6a20c036eef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:59.489976 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 491/993] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:24:59.491714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:24:59.591765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1b7c8-9dac-40c6-b7a5-662c5bf4fc76 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:24:59.626008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:24:59.626659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:24:59.626935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:24:59.627203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:24:59.627889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] RBAC: Adding query filter params (type=image) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:24:59.628188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:24:59.629571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73ea95-8359-463c-8d99-b64971275c3a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:24:59.634252 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 503/994] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:24:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:00.855097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb0a-90ed-4f8d-a494-9c43f731bbf8 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:00.855622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb0a-90ed-4f8d-a494-9c43f731bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:00.855622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb0a-90ed-4f8d-a494-9c43f731bbf8 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:00.857081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 492/995] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:00.862088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7309-7a17-41a4-87d7-3383c42d79fa None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:00.862465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7309-7a17-41a4-87d7-3383c42d79fa None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:00.862646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad7309-7a17-41a4-87d7-3383c42d79fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:00.880013 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-33ad7309-7a17-41a4-87d7-3383c42d79fa None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:00.881214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-33ad7309-7a17-41a4-87d7-3383c42d79fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:00.926603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:00.948328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 504/996] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:00.970510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cb0a-90ed-4f8d-a494-9c43f731bbf8 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:00.982251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80e1bc-34c2-4a8a-817e-b9f3f56bbb16 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:00.982542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80e1bc-34c2-4a8a-817e-b9f3f56bbb16 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:00.982820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80e1bc-34c2-4a8a-817e-b9f3f56bbb16 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:00.984168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 505/997] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:00.988922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:00.989313 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:00.989482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.007064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:01.008234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:01.105741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 506/998] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:01.110379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cb0a-90ed-4f8d-a494-9c43f731bbf8 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.126940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.148490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.154261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.155067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.155354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.155630 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.161027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.161027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:01.171490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:01.172652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:01.176993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 493/999] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:25:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:01.179415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.253119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941e16-d470-4118-b44a-34dd999e5159 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.266865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.300321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.301573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.301873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.302151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.302809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.304318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.305000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12c6d7-5b3c-481f-8b7e-4e2dded6d5ab None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:01.318119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:01.319162 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:01.319999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 507/1000] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:01.325639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.353925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.355164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.355453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.356124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.356920 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:01.357262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.359236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.369525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 494/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:01.370778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.447313 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.461400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03553f-2b94-493d-9171-7f526da1bbcd None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.493471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b4efa-a2cb-407d-990f-dd1e26582b09 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.496969 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.497627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.497911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.498189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.498888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:01.499195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.500586 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.505419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 508/1002] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:01.510970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.532497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.533187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.533471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.533755 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.534460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:01.534765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.536128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 495/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:01.548127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.559605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.623611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b274ef3-bd45-4f36-b77b-824a856535e4 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.646465 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01658701-3a50-4216-8d71-d535bd69e2b2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.660770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.661430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.661715 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.661991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.662691 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:01.662995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.664653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.669521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.675081 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 509/1004] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:01.676025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.685964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.686622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.686903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.687175 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.687987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] RBAC: Adding query filter params (interface=public, service_id=9d6a0fefca6b43b886bb9863152c9038, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:01.688269 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.689662 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6dcfb-0957-43f2-bea2-e1c1ba5ba9a1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.694487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 496/1005] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/endpoints?service_id=9d6a0fefca6b43b886bb9863152c9038&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:01.695740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187302a0-a3b4-4a49-8786-72346bb0a80e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.696028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187302a0-a3b4-4a49-8786-72346bb0a80e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.696302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187302a0-a3b4-4a49-8786-72346bb0a80e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.697582 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 497/1006] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:01.700503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187302a0-a3b4-4a49-8786-72346bb0a80e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:01.774798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288bd7d-5a9b-44f5-80d1-644118e451d6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.776363 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.799200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187302a0-a3b4-4a49-8786-72346bb0a80e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:01.808491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.809491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.813237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.813237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.813237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.813237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.831562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:01.832202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.832513 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.832786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.836071 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:01.836071 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1037c-3d04-4259-8f8c-d0a8f5ff3f28 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:01.841523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 498/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:25:01 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:25:01.842845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd9a-0814-46b9-9850-4813c79f1b35 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:01.843131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd9a-0814-46b9-9850-4813c79f1b35 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:01.843405 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389fd9a-0814-46b9-9850-4813c79f1b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:01.861164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d389fd9a-0814-46b9-9850-4813c79f1b35 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:01.862375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d389fd9a-0814-46b9-9850-4813c79f1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:01.897377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 510/1008] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:25:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:01.917944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:01.956426 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 499/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:01 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:01.975092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:02.091283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440a14-acd9-4272-bcab-0b6ed0b8cf47 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:02.125711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:02.126396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:02.126673 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:02.126947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:02.127671 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:02.129070 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83f9e6-3c0a-4635-b01f-05eb8bcbf609 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:02.205405 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 511/1010] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:25:01 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:03.907278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307236bd-74ee-4f96-9e7c-f50443a3909e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:03.907827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307236bd-74ee-4f96-9e7c-f50443a3909e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:03.907827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307236bd-74ee-4f96-9e7c-f50443a3909e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:03.912446 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 500/1011] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:03.914520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:03.914941 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:03.915105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:03.931977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:03.933768 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:03.950753 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:03.980151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2402865-0a82-4c71-946d-a595e21f59ac None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:03.980554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2402865-0a82-4c71-946d-a595e21f59ac None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:03.980833 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2402865-0a82-4c71-946d-a595e21f59ac None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:03.982236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 501/1012] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:03.987381 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:03.987680 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:03.987958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.005264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:04.006535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:04.009676 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 512/1013] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:03 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:04.032460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.080515 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 502/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:03 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:04.105087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.134497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1cb8-ca0c-469d-93e0-a6be52373890 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.171318 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.171597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.171888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.172561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.173938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:04.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:04.187020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:04.187888 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 513/1015] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:04.193482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.209167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.218943 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bae4c-a734-4b24-90d9-a3db9442d06d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.226406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.253748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.256260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.256260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.256260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.256260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.257749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2983070-af65-4afd-9065-710404b97ff9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.259410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 503/1016] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:04.260612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce01f-d24f-47fc-9164-63f6e61e97fa None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.260893 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce01f-d24f-47fc-9164-63f6e61e97fa None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.261174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce01f-d24f-47fc-9164-63f6e61e97fa None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.262364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 504/1017] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:04.265226 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ce01f-d24f-47fc-9164-63f6e61e97fa None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.295397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5aef8-8cf5-4c28-a9ce-f61cc11b64eb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.328573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.329222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.329509 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.329785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.330474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:04.330782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.332144 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de73f2-93a5-4c04-95ab-398dd5d00a65 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.336936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 514/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:04.336936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.336936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.336936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.356005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:04.357211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:04.366906 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ce01f-d24f-47fc-9164-63f6e61e97fa None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.399736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.400380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.400697 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.400967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.402155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.403562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.422478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 515/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:04 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:04.423227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.432129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.513505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 505/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:25:04 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:25:04.514329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.528869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90844f11-3dfb-49ae-81a0-1719a4cf7833 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.546147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.570489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.571176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.571455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.571729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.572495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:04.572808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.574823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.580875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 516/1021] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:04.586823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.633161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7c057-e5f5-4b97-859f-d675d3bef66a None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.666164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.675032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.675032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.675305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.675553 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.676201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.677587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:04.691477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:04.692727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:04.693795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 506/1022] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:04.699336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.704610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bdf4b-fec8-45b4-b60b-8633f942982c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.742084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.742752 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.743037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.743316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.744054 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.745504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.797829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:04.806980 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacbaec-dd4e-490e-a959-4df753d151d3 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:04.840254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:04.840969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:04.841253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:04.841526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:04.842224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] RBAC: Adding query filter params (name=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:04.842525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:04.843878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:04.848687 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 507/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:04.854164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:04.866117 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 517/1024] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:25:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:04.966172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de663c-826e-4c4d-bda6-69b535202efc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:05.009308 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:05.010005 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:05.010262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:05.011100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:05.011815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] RBAC: Adding query filter params (type=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:05.012120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:05.013515 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:05.023928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 508/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:05.025413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:05.140443 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456808b-8383-4309-a22d-b38322088e8c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:05.167214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:05.175507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:05.176175 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:05.176487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:05.176769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:05.177559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] RBAC: Adding query filter params (interface=public, service_id=f40fe093ef9c49559567e98fda17736e, region_id=RegionOne) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:05.177871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:05.184045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70e5df-8a06-4a1b-a135-b79f7f976663 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:05.194649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 518/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:25:05 2022] GET /identity/v3/endpoints?service_id=f40fe093ef9c49559567e98fda17736e&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:05.199198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:05.216145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:05.301694 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96568bca-45a6-4689-b2cc-39594e61b753 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:05.335245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:05.335914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:05.336199 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:05.336511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:05.337197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:05.338601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df732f2c-c153-4bd6-ba85-b2cb73e634ef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:05.352497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 509/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:25:05 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:25:06.613218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704a34-2ca4-47d7-be8e-96ef4a09d601 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:06.613737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704a34-2ca4-47d7-be8e-96ef4a09d601 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:06.613737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca704a34-2ca4-47d7-be8e-96ef4a09d601 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:06.615120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 519/1028] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:06.621193 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:06.621586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:06.621826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:06.639457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:06.640949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:06.708787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 510/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:06.732163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca704a34-2ca4-47d7-be8e-96ef4a09d601 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:06.837291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca704a34-2ca4-47d7-be8e-96ef4a09d601 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:06.871373 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:06.872085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:06.872367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:06.872668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:06.873841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:06.875277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497d28-fe18-4192-9096-c3e83ec73787 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:06.881620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 520/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:06.882881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:06.893844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:06.983478 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64a8dc-b9f5-48bb-a409-7a2f4cd41959 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.017683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.018368 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.018654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.018931 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.019632 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.021096 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.031880 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c682c-e825-4823-a0ca-f1733418d7a7 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.032165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c682c-e825-4823-a0ca-f1733418d7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.032464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c682c-e825-4823-a0ca-f1733418d7a7 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.033836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 521/1031] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:07.038694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.039074 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.039352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.056641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:07.058372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:07.084618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 511/1032] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:25:06 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:25:07.116514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.136553 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 522/1033] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:07.158193 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.229069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.270447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9058f-3593-40cc-b03f-458cd3d0d5cc None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.306078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.306893 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.307206 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.307484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.318024 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-3fd6fb16-c959-4db2-9ab6-e3602a2cf088 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:07.326138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:07.327125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:07.328031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 512/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:07.333348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.382047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80601-27ff-432e-a552-10ffb4d9c537 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.382383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80601-27ff-432e-a552-10ffb4d9c537 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.382618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80601-27ff-432e-a552-10ffb4d9c537 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.383968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 513/1035] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:07.389102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.389395 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.389606 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.406771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:07.407941 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:07.438344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a7e6e1-06bd-4b33-8fe7-bdee82c3d90b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.474037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.474710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.474989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.475261 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.475999 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:07.476303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.477697 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.484063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 514/1036] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:07.491411 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 523/1037] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:07.496834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.509270 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.555771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.561114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.603676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2870501-f5d8-4757-ba9d-e24886c1cf8d None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.611558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa714d6-988e-4fdb-a5c6-44e9381d1a15 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.640698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.641414 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.641698 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.641972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.649560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.650928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.651866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.652293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] PATH_INFO: `/v3/services/image` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.652740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.653290 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.654176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.654984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:07.667365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:07.668580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:25:07.669644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:07.671401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:07.672457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:07.673575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:07.673575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:07.673575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:07.673575 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:07.674362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 524/1038] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:07.677352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 515/1039] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:07.678241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.681525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.783867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67f4d8-29fa-4d9a-80ca-215fc8972687 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.791169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039198-ace8-451a-8924-e9a45a34432f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.798665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.806426 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:07.820585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.821948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.822407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.823587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.825614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:07.826153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.828795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.835387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.836058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.836340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.836657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.837393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] RBAC: Adding query filter params (name=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:07.837728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.839636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:07.844016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 525/1040] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:07.848453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 516/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:07.849185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.850364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:07.954871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a30ef-2997-4066-9f4b-b0f5a4bf1804 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.961584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30c63f-6b34-4e84-ba72-8f999d0fed9e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:07.989828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.990858 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.991141 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.991412 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.997915 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:07.998570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:07.998853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:07.999125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:07.999235 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:07.999821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] RBAC: Adding query filter params (type=image) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:08.000124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.000670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.001490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.006512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 517/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:08.012636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:25:08.015700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:08.016670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:08.017693 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 526/1043] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:25:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:08.022372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:08.049864 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:08.058400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:08.124348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b325959-2d13-4319-97b7-52617c4f1f14 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:08.127061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401e39e-8d25-4dfc-a050-068aa05abf2b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:08.160161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:08.160839 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:08.161119 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:08.161390 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:08.162105 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.163029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:08.163484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.163694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:08.163979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:08.164257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:08.165211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:08.165705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.167368 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.187944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 527/1044] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:25:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:08.191611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:08.273183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 518/1045] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:25:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:08.288786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:08.295330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9da29-fafd-4435-b95d-92dd37f83e17 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:08.340208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:08.340902 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:08.341181 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:08.341453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:08.412898 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.414356 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.509381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:08.522308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 528/1046] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:25:08.528460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:08.622215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:08.632356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e980ff-336e-41a2-86cd-764230de5054 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:08.667199 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:08.667989 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:08.668277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:08.668588 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:08.679187 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.680733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:08.698664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:08.699601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:08.701059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:08.701059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:08.701059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:08.701059 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:08.704547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 519/1047] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:08.705532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:08.809234 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91092626-cf32-43ef-af92-c339bafb5352 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:08.887754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:08.888440 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:08.888781 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:08.889098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:08.889889 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:08.890202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:08.891560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:08.903024 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 529/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:08.908339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.008510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f5011-f5b8-40fb-8172-408fc326dd2c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.042539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.043337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.043675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.043947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.050754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:09.052201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ea8f16d8-dae8-4ad3-8700-01bbfb8af8c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:25:09.067070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:09.067979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:09.069434 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:09.070154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 520/1049] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:09.074126 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.125320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:09.174257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7368fd1-639f-43c3-8792-1ea91e774756 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.184882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff416e-82a1-4bda-a2b5-6a7a081ef4de None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.185161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff416e-82a1-4bda-a2b5-6a7a081ef4de None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.185430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff416e-82a1-4bda-a2b5-6a7a081ef4de None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.186791 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 521/1050] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:09.191740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.192300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.197480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:09.209855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:09.211055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:09.221868 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.223224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.223646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.223930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.224749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:09.225488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:09.227719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:09.241795 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 530/1051] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:09.248480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.284273 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 522/1052] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:09.308880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.357115 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e7568-405b-4187-a4df-1aa09e1e08ff None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.367466 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:09.393380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.394032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.394319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.394591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.395419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] RBAC: Adding query filter params (role.id=e81817fdd33a44c0b6121a23432bcb5f, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:09.395728 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:09.397214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:09.412442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 531/1053] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=e81817fdd33a44c0b6121a23432bcb5f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:09.416447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9f07d-54b8-4064-bb0d-7fb8028b2c37 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.447287 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:09.453125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.456621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.456621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.456621 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.467819 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:09.476463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:09.477492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:09.484219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 523/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:09.486547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.592158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b21d5-4619-4b88-9cd8-fa9cd405f457 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.626442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.627041 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.627323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.627600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.628336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:09.628688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:09.630061 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:09.642763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 532/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:09.644316 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.745851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1864b46-c441-4a86-a7a8-da09b25b6e78 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.779077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073e9c-f41f-4512-b038-546277896185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.779946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073e9c-f41f-4512-b038-546277896185 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.780224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073e9c-f41f-4512-b038-546277896185 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.780527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03073e9c-f41f-4512-b038-546277896185 None admin] PATH_INFO: `/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:09.794383 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073e9c-f41f-4512-b038-546277896185 None admin] RBAC: Authorizing `identity:get_user(user_id=f3e9c157cf864dabaaa11b4bfb33d09b)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:09.795830 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03073e9c-f41f-4512-b038-546277896185 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:09.797802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 524/1056] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:09.803475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:09.838323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:09.911468 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc1ef-6c99-476b-aa40-6d6f279e4b55 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:09.944954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:09.945620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:09.945905 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:09.946179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.013110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:10.014556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:10.047281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:10.117893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 533/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:10.119231 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073e9c-f41f-4512-b038-546277896185 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:10.171033 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:10.233161 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03073e9c-f41f-4512-b038-546277896185 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:10.267892 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:10.268774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.269086 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.269364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.270534 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:10.271954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5eab7-e195-46a5-89a0-c20d626087db None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:10.273918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 525/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:10 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:10.279787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:10.333657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0021-34ea-4b5e-8d42-6375d292f8d1 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.333942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0021-34ea-4b5e-8d42-6375d292f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.334209 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0021-34ea-4b5e-8d42-6375d292f8d1 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.335697 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 526/1059] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:10.340249 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.340566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.340845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.356854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:10.358014 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:10.383850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8925d306-5438-456a-a627-5ba0498e227a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:10.420314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:10.420994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.421372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.421603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.422617 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7d2aa812729749e29f58d56ababe63bf, user.id=f3e9c157cf864dabaaa11b4bfb33d09b) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:10.422959 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:10.424453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 527/1060] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:10.424564 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:10.426342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:10.431137 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 534/1061] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:10 2022] GET /identity/v3/role_assignments?user.id=f3e9c157cf864dabaaa11b4bfb33d09b&scope.project.id=7d2aa812729749e29f58d56ababe63bf&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:10.447270 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:10.502950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:10.558826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8a4bf-6d22-4335-bb2e-df8f6c6c493f None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:10.594714 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:10.595351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.595633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.595909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.664824 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:10.666824 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:10.712793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:10.768484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 528/1062] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:10.770327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:10.870804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51805-1e6d-4b5e-a694-d093c3f3f6ad None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:10.906223 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:10.907015 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:10.907293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:10.907563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:10.918128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:10.919565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-10a0c176-6f6a-4e3f-a8ea-43ee7ed8519e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:10.940705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:10.941648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:10.942560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:10.942560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:10.942560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:10.942560 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:10.950451 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 535/1063] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:10.950590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:11.046376 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf305e-b76c-4e92-8af4-c8fd09f06084 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:11.080645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:11.081302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.081579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.081845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:11.082554 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:11.082853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:11.084262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5506801-1dfe-4b73-baf4-b147893e07a6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:11.096565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 529/1064] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:11.440381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1255-adb4-47bf-9e48-122e1995d9f6 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.440700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1255-adb4-47bf-9e48-122e1995d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.440976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1255-adb4-47bf-9e48-122e1995d9f6 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:11.442346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 536/1065] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:11.447552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.447841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.448116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:11.464393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:11.465594 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:11.467522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:11.532690 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 530/1066] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:11.555287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1255-adb4-47bf-9e48-122e1995d9f6 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:11.611561 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:11.661357 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1255-adb4-47bf-9e48-122e1995d9f6 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:11.694109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:11.694845 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.695127 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.695399 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:11.705209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:11.713804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:11.714896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:11.715754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:25:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:11.720997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:11.814764 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e96b-5f29-4e46-ab80-688ce185f186 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:11.846679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:11.847331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.847612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.847884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:11.848654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:11.848956 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:11.850299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:11.855736 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:11.858891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:25:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:11.864469 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:11.962289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553d61b-b74f-4260-adc8-522068a9579b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:11.973183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:11.996631 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:11.997504 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:11.997804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:11.998078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.008635 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.010079 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:12.027289 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:12.028200 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:12.029179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:12.029179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:12.029179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:12.029179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:12.029179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 538/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:12.034340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.130740 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a8b35-5234-45f4-8d0a-335f7744b8f7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.164535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.165194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.165480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.165758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.166618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:12.166926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.168288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.179962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 532/1070] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:12.185991 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.286841 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b10a21-4190-4f89-a5ef-a26da7249a58 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.320092 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.320914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.321198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.321478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.329661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.331121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7caa853d-9acd-4c87-8b46-55e03bb134f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:25:12.345543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:12.346506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:12.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 539/1071] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:12.352570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.410545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.449919 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983903-adb9-4380-b79c-bade0e3142f9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.459980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da717f4-ccc5-4eda-a161-738bb4ac2314 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.460278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da717f4-ccc5-4eda-a161-738bb4ac2314 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.460600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da717f4-ccc5-4eda-a161-738bb4ac2314 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.461965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 540/1072] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:12.466821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.467108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.467382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.483977 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.484676 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.484785 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:12.484958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.485233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.485871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:12.486067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:12.486374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.487790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.503134 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.506735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 533/1073] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:12.512853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.555085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 541/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:12.578557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.609319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6365d-8bbf-42e6-bbf0-0edbecd676c7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.627115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.644778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.645586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.645937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.646178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.656471 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.657981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.673816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa18558-51d9-4624-ad49-1b86a3aeded4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:12.675415 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:12.676347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:12.677410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:12.677410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:12.677410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:12.677410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:12.677410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 534/1075] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:12.682665 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.708917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.709705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.709988 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.710257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.720196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:12.727727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:12.734219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 542/1076] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:12.735211 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.749904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.781723 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e1697-f81b-4fdf-9871-39daea89afc8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.816143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.816761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.817009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.817281 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.817987 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:12.818286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.819626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.832483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d19da2-f222-47e3-9100-4d32ab93e7d9 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.832722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 535/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:12.835969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.865451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.866811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.867468 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.867749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.868022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.868788 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:12.869091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.870507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.878380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 543/1078] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:12.884037 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:12.933926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5c69-61b0-4c75-9058-52c612691231 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.959365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:12.967049 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:12.967967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:12.968253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:12.968569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:12.975227 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:12.976683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:12.983337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a503ac8-3998-40be-bcea-d8014c5e1d44 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:25:12.991150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:12.992025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:12.992964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 536/1079] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:12.998263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:13.019540 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:13.020424 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:13.020708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:13.020980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] PATH_INFO: `/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:13.022158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] RBAC: Authorizing `identity:get_user(user_id=f3e9c157cf864dabaaa11b4bfb33d09b)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:13.023582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:13.025225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 544/1080] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:13.031361 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:13.086786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:13.096287 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966bcb5-874b-412e-98bf-447dc3e55bb7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:13.127382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac34f26-742a-4663-aaba-e98f3556f9ec None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:13.130235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:13.130889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:13.131188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:13.131476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:13.132511 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:13.133006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:13.134756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:13.146492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 537/1081] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:25:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:13.152966 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:13.160911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:13.161753 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:13.162030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:13.162301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:13.163453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:13.164914 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:13.166615 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 545/1082] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:13 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:13.172315 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:13.187758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:13.258532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f98f7-ffe3-4a63-add3-e194747bc626 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:13.271736 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116cb5-22f5-47b1-bd87-9c574f3ee5b7 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:13.291646 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:13.292566 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:13.292847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:13.293121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/e81817fdd33a44c0b6121a23432bcb5f` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:13.295355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=d620bd7c93f640ef8ec03ea691926996, role_id=e81817fdd33a44c0b6121a23432bcb5f)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:13.296828 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3cae2-2d4c-46c3-99d0-d5c9957e2d01 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:13.304295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:13.305207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:13.305489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:13.305763 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf/users/f3e9c157cf864dabaaa11b4bfb33d09b/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:13.308229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d2aa812729749e29f58d56ababe63bf, user_id=f3e9c157cf864dabaaa11b4bfb33d09b, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:13.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b1d9-837f-4596-bf20-2521581ec734 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:13.390051 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 538/1083] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:25:13 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/d620bd7c93f640ef8ec03ea691926996/roles/e81817fdd33a44c0b6121a23432bcb5f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:25:13.409926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 546/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:25:13 2022] PUT /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf/users/f3e9c157cf864dabaaa11b4bfb33d09b/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:25:15.384085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6a9-d001-4093-ad48-ef6f1a1cf9cc None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.384645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6a9-d001-4093-ad48-ef6f1a1cf9cc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.384645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25d6a9-d001-4093-ad48-ef6f1a1cf9cc None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.386510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 539/1085] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:15.391463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.391906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.392010 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.402097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316ba0-79cf-47e6-aff9-07ce97e86d36 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.402379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316ba0-79cf-47e6-aff9-07ce97e86d36 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.402653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316ba0-79cf-47e6-aff9-07ce97e86d36 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.403934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 540/1086] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:15.408763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.409046 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.409275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:15.409371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.410448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:15.425074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:15.426210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:15.428870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.471973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.477204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 547/1087] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:15.491057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 541/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:15.501124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.515108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.598647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eacd3f-3478-4bba-804d-203c0d852ad0 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.611444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247235e6-ff7a-4adc-9e5a-c653fb32626b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.631483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.632287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.632594 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.632865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.643323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:15.645462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.646240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.646524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.646800 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:15.651297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:15.652388 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:15.653465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:15.657179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.658365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.660066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:15.667765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:15.671609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:15.672499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 542/1090] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:15.674735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.717077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.757514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917b3f6-494f-4d02-9690-50316fc4d340 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.773304 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0b691-ab69-44fc-8973-2722331f8bd5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.790629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.791786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.792069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.792347 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.793113 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:15.793417 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:15.794780 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:15.802556 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 549/1091] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:15.807217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.807964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.808250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.808561 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.808708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.809297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:15.809597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:15.810939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:15.819277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 543/1092] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:15.824914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.884983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.914252 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47439c17-c4eb-4b4b-b45b-6e8146c77bc5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.922994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343f88-9eb5-48be-8d97-3a56cfa91706 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:15.936774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:15.948165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.948973 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.949257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.949536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.956922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:15.957783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:15.958121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:15.958401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] PATH_INFO: `/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:15.959620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] RBAC: Authorizing `identity:get_user(user_id=f3e9c157cf864dabaaa11b4bfb33d09b)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:15.959726 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:15.961156 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:15.961262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:15.962848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 544/1093] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/users/f3e9c157cf864dabaaa11b4bfb33d09b => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:15.968569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:15.979224 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:15.980360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:15.981335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:15.981335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:15.981335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:15.981335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:15.984550 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 550/1094] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:15.986201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.070165 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651e05d-31d8-4e39-a9be-79a6e1f8c58c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.085705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c603b-b0f2-45ee-bbe4-55e6d7e87446 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.097613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.103273 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.104421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.104712 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.104983 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.119797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.120460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.120745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.121020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.121721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:16.122022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.123382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.136434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 551/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:16.140860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.171516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.173237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.173437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.241279 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df72b-0e7b-4771-b831-1b70d6b02293 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.270937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 545/1096] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:25:16.274855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.276212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.276461 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.276739 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.277362 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.283992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.285464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:25:16.300222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:16.301232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:16.302197 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 552/1097] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:25:16.307001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.310214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.379002 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d659-b538-48ff-a16a-d9f9a999c9c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.396513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.403464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5097e2-bcc8-400b-a55a-d657bb8a6ff5 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.411904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.412783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.413066 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.413382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.414542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.416653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.418332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 546/1098] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:16.424366 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.437755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.438421 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.438708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.438989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.439819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:16.440131 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.441592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.458193 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 553/1099] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:16.464291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.519192 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.522854 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de07b67-dd25-4e8b-a411-832c96f06bac None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.556785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.557439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.557744 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.557999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.558823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7d2aa812729749e29f58d56ababe63bf, user.id=f3e9c157cf864dabaaa11b4bfb33d09b) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:16.559137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.560590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.562752 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573a5fa-36ab-4af9-9c70-151bc61972a1 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.566274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 547/1100] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/role_assignments?user.id=f3e9c157cf864dabaaa11b4bfb33d09b&scope.project.id=7d2aa812729749e29f58d56ababe63bf&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:16.601492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.602441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.602729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.626285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:16.674437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.675814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.775136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 554/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:25:16.781401 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.878053 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f17dd1-4f8e-4efe-9494-5f9a85f65249 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:16.911645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:16.912458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:16.912746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:16.913021 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:16.922964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:16.924391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:16.941774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:16.942816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:16.943748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:25:16.943748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:16.943748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:25:16.943748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:16.943748 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 548/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:16.949094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:16.999948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:17.045687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c3c88-ec3d-4a8a-b499-7654e0872db2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:17.078080 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:17.078732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:17.079016 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:17.079296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:17.080005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:17.080310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:17.081732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:17.093670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 555/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:17.099179 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:17.114877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:17.197151 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466451b-5bfd-49b9-974e-f23761c4b807 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:17.233100 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:17.233878 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:17.234154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:17.234423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:17.241425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:17.242871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:25:17.256409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:17.257455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:17.258398 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 549/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:25:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:17.263387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:17.361818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b94fc-884b-4769-82e6-4674ef4f5f71 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:17.374517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:17.395255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:17.395863 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:17.396140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:17.396439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:17.397241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:17.397874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:17.398949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf57ca7-14f3-4a2a-89a1-ec2a8593cf70 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:17.411418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 556/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:25:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:17.418099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:17.492476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:17.516784 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018977a-8d8e-4071-8450-d63ab256c804 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:17.549832 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:17.550472 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:17.550754 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:17.551025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:17.551835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] RBAC: Adding query filter params (role.id=e81817fdd33a44c0b6121a23432bcb5f, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=d620bd7c93f640ef8ec03ea691926996) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:17.552144 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:17.553583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9b3bd-9b94-47a7-8753-293554df47cc None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:17.559190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 550/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:17 2022] GET /identity/v3/role_assignments?user.id=d620bd7c93f640ef8ec03ea691926996&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=e81817fdd33a44c0b6121a23432bcb5f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:18.628510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53398-9b15-46d9-b86a-57a2f21488f4 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:18.629059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53398-9b15-46d9-b86a-57a2f21488f4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:18.629059 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53398-9b15-46d9-b86a-57a2f21488f4 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:18.630415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 557/1107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:18.635570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:18.636004 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:18.636107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:18.652921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:18.654073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:18.717826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 551/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:18.742095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53398-9b15-46d9-b86a-57a2f21488f4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:18.839166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53398-9b15-46d9-b86a-57a2f21488f4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:18.872689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:18.873454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:18.873734 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:18.874005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:18.875142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:18.876584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5c10e-fd18-4ab1-88c9-b41bb2b5dbe7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:18.878155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 558/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:18.883827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:18.946805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:18.977863 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ae90-76ff-4abe-8052-559b3026c0cc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:19.011073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:19.011729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:19.012011 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:19.012287 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:19.013013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:19.014430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2017e7cd-b682-4080-ada2-dbef5e33031f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:19.065074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 552/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:25:18 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:25:21.108213 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81103-cbbe-4708-a327-02615ae40838 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.108900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81103-cbbe-4708-a327-02615ae40838 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.108900 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe81103-cbbe-4708-a327-02615ae40838 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.110155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 559/1111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:21.115387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.115767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.115939 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.132617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:21.133769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:21.199423 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 553/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:21.223259 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81103-cbbe-4708-a327-02615ae40838 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:21.264797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:21.320187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe81103-cbbe-4708-a327-02615ae40838 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:21.353118 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:21.353970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.354247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.354514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] PATH_INFO: `/v3/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.355940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] RBAC: Authorizing `identity:get_role(role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:21.357325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:21.358706 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 560/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:21 2022] GET /identity/v3/roles/1e933b37fb62445f9e9755ca954a80cd => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:21.364392 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:21.417354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:21.460087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cc858-ba0f-4924-b7ab-288bcfcb785b None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:21.498852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:21.499729 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.500017 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.500294 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] PATH_INFO: `/v3/users/7015135b02dd46c085974cac9a8bf8d6` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.514456 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] RBAC: Authorizing `identity:get_user(user_id=7015135b02dd46c085974cac9a8bf8d6)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:21.515894 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:21.517608 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 554/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:21 2022] GET /identity/v3/users/7015135b02dd46c085974cac9a8bf8d6 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:21.523894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:21.617179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73826d5a-a47d-44cb-8871-e435219dd37b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:21.626328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:21.650276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:21.650907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.651187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.651460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.715573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:21.716994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:21.809906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 561/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:25:21.815757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:21.912090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc13eaf-4cf3-40c1-91f0-f6e23a11e24f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:21.924022 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:21.943556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:21.944385 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:21.944697 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:21.944969 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:21.946115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:21.948050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca939371-d1b9-4a1a-877a-27dcd5167711 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:21.949726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 555/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:21 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:21.955831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:21.966152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:22.049714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e9f29-8da9-4e65-bd10-d6264fa072cc None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:22.081874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:22.082513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:22.082796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:22.083068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:22.083881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=7d2aa812729749e29f58d56ababe63bf, user.id=7015135b02dd46c085974cac9a8bf8d6) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:22.084191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:22.085641 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee427e6-e4b9-4ff1-abb5-908fbbb4681b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:22.091521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 562/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:21 2022] GET /identity/v3/role_assignments?user.id=7015135b02dd46c085974cac9a8bf8d6&scope.project.id=7d2aa812729749e29f58d56ababe63bf&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:24.081992 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18487-79fc-4b11-ab59-ba45686b1693 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.082541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18487-79fc-4b11-ab59-ba45686b1693 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.082541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d18487-79fc-4b11-ab59-ba45686b1693 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.083884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 556/1118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:24.089660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859fd8-8635-4190-9080-94220158d437 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.090033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859fd8-8635-4190-9080-94220158d437 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.090222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859fd8-8635-4190-9080-94220158d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.106418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-bb859fd8-8635-4190-9080-94220158d437 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:24.107601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-bb859fd8-8635-4190-9080-94220158d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:24.171267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:24.194002 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d18487-79fc-4b11-ab59-ba45686b1693 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:24.292244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d18487-79fc-4b11-ab59-ba45686b1693 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:24.324062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:24.324932 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.325217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.325495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] PATH_INFO: `/v3/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.326944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] RBAC: Authorizing `identity:get_role(role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:24.328293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:24.329670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 557/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:24 2022] GET /identity/v3/roles/1e933b37fb62445f9e9755ca954a80cd => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:24.335647 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859fd8-8635-4190-9080-94220158d437 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:24.338448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:24.433061 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859fd8-8635-4190-9080-94220158d437 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:24.465878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:24.466735 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.467017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.467294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] PATH_INFO: `/v3/users/7015135b02dd46c085974cac9a8bf8d6` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.468492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] RBAC: Authorizing `identity:get_user(user_id=7015135b02dd46c085974cac9a8bf8d6)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:24.469916 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:24.471535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 564/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:24 2022] GET /identity/v3/users/7015135b02dd46c085974cac9a8bf8d6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:24.477309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:24.524735 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:24.574086 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28e1f-1f22-407f-ae24-a164fb1c4106 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:24.608520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:24.609306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.609590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.609866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.611031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:24.612467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88971a7-a08e-4ab2-ad41-6a58d967fac1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:24.614142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 558/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:24 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:24.620515 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:24.686975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:24.716264 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03186ae8-13c9-46f2-b532-6ffbe016fb2d None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:24.747984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:24.748879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:24.749158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:24.749430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf/users/7015135b02dd46c085974cac9a8bf8d6/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:24.751557 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d2aa812729749e29f58d56ababe63bf, user_id=7015135b02dd46c085974cac9a8bf8d6, role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:24.753009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169632e-aaa6-469c-b184-f9a3b55cddb5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:24.817462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 565/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:25:24 2022] PUT /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf/users/7015135b02dd46c085974cac9a8bf8d6/roles/1e933b37fb62445f9e9755ca954a80cd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:25:26.805688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9d76-00ad-4fbb-b384-49dc247db280 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:26.806855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9d76-00ad-4fbb-b384-49dc247db280 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:26.806855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9d76-00ad-4fbb-b384-49dc247db280 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:26.808198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 559/1124] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:26.813448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:26.813826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:26.814005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:26.831531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:26.832735 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:26.896463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 566/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:26.919618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c9d76-00ad-4fbb-b384-49dc247db280 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:27.018007 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c9d76-00ad-4fbb-b384-49dc247db280 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:27.033063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:27.050325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:27.051164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:27.051448 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:27.051723 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] PATH_INFO: `/v3/roles/1e933b37fb62445f9e9755ca954a80cd` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:27.053238 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] RBAC: Authorizing `identity:get_role(role_id=1e933b37fb62445f9e9755ca954a80cd)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:27.054577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:27.055940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 560/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:26 2022] GET /identity/v3/roles/1e933b37fb62445f9e9755ca954a80cd => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:27.062140 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:27.119496 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:27.157882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c98ea0-8655-4694-884e-a2ea91628561 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:27.191703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:27.192611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:27.192891 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:27.193163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] PATH_INFO: `/v3/users/7015135b02dd46c085974cac9a8bf8d6` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:27.194320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] RBAC: Authorizing `identity:get_user(user_id=7015135b02dd46c085974cac9a8bf8d6)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:27.195748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:27.197642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 567/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:27 2022] GET /identity/v3/users/7015135b02dd46c085974cac9a8bf8d6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:27.203120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:27.298652 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a5440-9f80-41bd-a425-c188abfcd7ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:27.330439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:27.331064 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:27.331344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:27.331615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:27.380682 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:27.395256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:27.396708 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:27.491393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:25:27.497802 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:27.592136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee17f1-c5e5-4db1-a80c-6bb7d19bceba None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:27.617273 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:27.625127 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:27.625964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:27.626239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:27.626507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] PATH_INFO: `/v3/projects/7d2aa812729749e29f58d56ababe63bf` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:27.627664 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] RBAC: Authorizing `identity:get_project(project_id=7d2aa812729749e29f58d56ababe63bf)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:27.629145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232057e-818a-4f5a-a10c-e80504b1ebd4 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:27.630792 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 568/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:27 2022] GET /identity/v3/projects/7d2aa812729749e29f58d56ababe63bf => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:27.637430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:27.716818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:27.731461 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82fec-d049-4083-8497-bdb0ef9a77f6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:27.765197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:27.765828 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:27.766112 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:27.766387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:27.767205 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] RBAC: Adding query filter params (role.id=1e933b37fb62445f9e9755ca954a80cd, scope.project.id=7d2aa812729749e29f58d56ababe63bf, user.id=7015135b02dd46c085974cac9a8bf8d6) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:27.767516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:27.768955 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6237a30-38f3-4387-998b-582b695b0282 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:27.774573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 562/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:27 2022] GET /identity/v3/role_assignments?user.id=7015135b02dd46c085974cac9a8bf8d6&scope.project.id=7d2aa812729749e29f58d56ababe63bf&role.id=1e933b37fb62445f9e9755ca954a80cd => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:29.782678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef15e0-bed6-41d1-97bd-cc2da77b1342 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:29.783230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef15e0-bed6-41d1-97bd-cc2da77b1342 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:29.783230 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef15e0-bed6-41d1-97bd-cc2da77b1342 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:29.784633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 569/1131] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:29.789789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:29.790260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:29.790364 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:29.806944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:29.808092 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:29.871704 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 563/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:25:29.894320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef15e0-bed6-41d1-97bd-cc2da77b1342 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:29.992824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef15e0-bed6-41d1-97bd-cc2da77b1342 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:30.025102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:30.025882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:30.026161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:30.026430 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:30.027584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:30.029041 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d79a8-39dd-4295-ba7e-db0cb7a900f5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:30.030825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 570/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:30.036516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:30.111372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:30.132204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa7244-763f-4e26-a650-789626f9f18c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:30.166043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:30.166681 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:30.166964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:30.167240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:30.167947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:30.169394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e61962-2768-4703-899c-c0e69a2c900b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:30.249093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 564/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:25:30 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:32.281593 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c2a2-1ce6-4749-8564-81dc20053b01 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:32.282097 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c2a2-1ce6-4749-8564-81dc20053b01 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:32.282210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6c2a2-1ce6-4749-8564-81dc20053b01 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:32.283519 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 571/1135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:25:32.288693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:32.289090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:32.289248 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:32.306843 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:32.308020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:32.372152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:32.396384 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c2a2-1ce6-4749-8564-81dc20053b01 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:32.456692 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:32.492855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6c2a2-1ce6-4749-8564-81dc20053b01 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:32.525046 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:32.525808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:32.526087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:32.526359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:32.527494 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:32.528947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124984b0-ce2a-4a75-9983-beeabbba8a41 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:32.530530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 572/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:32.536070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:32.592767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:32.632356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e16d-6c1e-4e7a-920a-12f1a911cbb4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:32.667244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:32.667898 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:32.668176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:32.668473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:32.669176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:32.670587 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f203-a161-424c-bc2e-c98478acab2f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:32.773074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 566/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:25:32 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:34.821818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5368e-2cd4-4323-a6ec-aa0fc759443d None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:34.822348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5368e-2cd4-4323-a6ec-aa0fc759443d None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:34.822439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5368e-2cd4-4323-a6ec-aa0fc759443d None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:34.823737 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 573/1139] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:34.828941 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:34.829378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:34.829477 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:34.845686 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:34.846852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:34.910895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:34.934630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5368e-2cd4-4323-a6ec-aa0fc759443d None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.032661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5368e-2cd4-4323-a6ec-aa0fc759443d None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.060665 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:35.065285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.066051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.066339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.066613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.076297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:35.083741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:35.084948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:35.086391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 574/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:35.091274 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.135857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:35.186922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793d4a3-36e7-45bd-831d-d063e6eba5ec None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.220661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.221315 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.221602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.221879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.222616 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:35.222922 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:35.224278 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:35.232006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 568/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:35.237655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.333282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06d851-4e57-4eb7-a444-13a5f51ddbfc None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.365029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.365866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.366145 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.366415 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] PATH_INFO: `/v3/users/b77279a71bf2487fb0802c0c082b7ef3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.379489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] RBAC: Authorizing `identity:get_user(user_id=b77279a71bf2487fb0802c0c082b7ef3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:35.380941 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:35.382520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 575/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:35 2022] GET /identity/v3/users/b77279a71bf2487fb0802c0c082b7ef3 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:35.388173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.482722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fcefe-291b-4658-afa7-d7699c9c57ea None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.491263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:35.514949 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.515612 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.515890 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.516163 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.580068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:35.581528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:35.674958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:35.681360 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.728743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:35.776993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68901589-3cd8-4c16-9c26-a9637307928f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.809149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.809986 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.810265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.810535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] PATH_INFO: `/v3/projects/31637686134042eb8b062f4e01dafa26` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.811695 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] RBAC: Authorizing `identity:get_project(project_id=31637686134042eb8b062f4e01dafa26)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:35.813150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeaf63a-5a23-498f-a010-60738bf29ffe None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:35.814820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 576/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:35 2022] GET /identity/v3/projects/31637686134042eb8b062f4e01dafa26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:35.820699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:35.830982 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:35.916349 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ea8c0-b3c0-4562-ac99-f2be016a25e8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:35.949580 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:35.950159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:35.950440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:35.950715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:35.951535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=31637686134042eb8b062f4e01dafa26, user.id=b77279a71bf2487fb0802c0c082b7ef3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:35.951847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:35.953288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4dcb8-710c-4d7c-9dba-c0d548acf30d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:35.958744 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 570/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:35 2022] GET /identity/v3/role_assignments?user.id=b77279a71bf2487fb0802c0c082b7ef3&scope.project.id=31637686134042eb8b062f4e01dafa26&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:37.944649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d905f-f2e3-4de0-8128-6fb1ea395bfe None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:37.945253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d905f-f2e3-4de0-8128-6fb1ea395bfe None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:37.945253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d905f-f2e3-4de0-8128-6fb1ea395bfe None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:37.946604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 577/1147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:37.951874 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:37.952257 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:37.952455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:37.969141 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:37.970301 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:38.035927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 571/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:38.058448 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d905f-f2e3-4de0-8128-6fb1ea395bfe None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:38.158485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d905f-f2e3-4de0-8128-6fb1ea395bfe None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:38.174865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:38.191525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:38.192306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:38.202288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:38.202288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:38.203319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:38.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:38.211928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:38.213086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 578/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:38.218340 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:38.220510 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:38.314296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ec8c3-2114-426c-b906-c3fa40d66578 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:38.346539 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:38.347178 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:38.347455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:38.347724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:38.348475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:38.348779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:38.350122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:38.358250 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 572/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:38.363815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:38.458620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8dee0-7c07-403e-815b-26aa9fbd1499 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:38.490489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:38.491330 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:38.491612 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:38.491901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] PATH_INFO: `/v3/users/b77279a71bf2487fb0802c0c082b7ef3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:38.493642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] RBAC: Authorizing `identity:get_user(user_id=b77279a71bf2487fb0802c0c082b7ef3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:38.495071 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:38.496687 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 579/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:38 2022] GET /identity/v3/users/b77279a71bf2487fb0802c0c082b7ef3 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:38.502138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:38.562224 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:38.599167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b66cc-8a90-4f4a-8187-70f74be3cdee None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:38.632034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:38.632903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:38.633188 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:38.633495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] PATH_INFO: `/v3/projects/31637686134042eb8b062f4e01dafa26` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:38.634649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] RBAC: Authorizing `identity:get_project(project_id=31637686134042eb8b062f4e01dafa26)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:38.636061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9b78-b8d2-432a-83a3-a6e368a39f48 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:38.637742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 573/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:38 2022] GET /identity/v3/projects/31637686134042eb8b062f4e01dafa26 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:38.643376 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:38.689265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:38.742091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1e2b-3f18-457d-a172-a6fde56cd42b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:38.773280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:38.774683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:38.774965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:38.775240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] PATH_INFO: `/v3/projects/31637686134042eb8b062f4e01dafa26/users/b77279a71bf2487fb0802c0c082b7ef3/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:38.777182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] RBAC: Authorizing `identity:create_grant(project_id=31637686134042eb8b062f4e01dafa26, user_id=b77279a71bf2487fb0802c0c082b7ef3, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:38.778607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e44d1-ed5c-4483-bc84-77431201d873 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:38.841571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 580/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:25:38 2022] PUT /identity/v3/projects/31637686134042eb8b062f4e01dafa26/users/b77279a71bf2487fb0802c0c082b7ef3/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:25:40.818185 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05e65-01d4-43b5-82a1-f4d51e042b54 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:40.818738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05e65-01d4-43b5-82a1-f4d51e042b54 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:40.818738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc05e65-01d4-43b5-82a1-f4d51e042b54 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:40.820078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 574/1154] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:40.825150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:40.825563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:40.825703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:40.842124 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:40.843285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:40.907798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 581/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:40.931394 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc05e65-01d4-43b5-82a1-f4d51e042b54 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.031108 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc05e65-01d4-43b5-82a1-f4d51e042b54 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.058806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:41.063495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.064264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.064581 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.064856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.075177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:41.082544 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:41.083691 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:41.084627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 575/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:41.090025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.123542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:41.184762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98540345-ca6a-441b-83ac-2edffc3f92ab None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.218525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.219184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.219497 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.219775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.220541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:41.220848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:41.222209 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:41.230568 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 582/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:41.236257 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.331166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241813a-f606-4b45-9c35-dea8a502a175 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.363027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.363867 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.364146 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.364692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] PATH_INFO: `/v3/users/b77279a71bf2487fb0802c0c082b7ef3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.365857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] RBAC: Authorizing `identity:get_user(user_id=b77279a71bf2487fb0802c0c082b7ef3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:41.367264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:41.369475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 576/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:41 2022] GET /identity/v3/users/b77279a71bf2487fb0802c0c082b7ef3 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:41.375000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.466452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:41.470097 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c516bd-4c02-4c43-b95c-4f10d3184893 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.503102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.503729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.504012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.504284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.567592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:41.569064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:41.659000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:41.663174 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 583/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:41.668856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.725453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:41.764702 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d52b9-3637-4e72-90f2-f6073ecbb56e None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.797091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.797953 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.798230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.798499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] PATH_INFO: `/v3/projects/31637686134042eb8b062f4e01dafa26` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.799638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=31637686134042eb8b062f4e01dafa26)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:41.801145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52d75-4f4d-417f-b564-d39aa8e5c7f7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:41.802783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 577/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:41 2022] GET /identity/v3/projects/31637686134042eb8b062f4e01dafa26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:41.809364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:41.904001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcca9ec-6071-4879-8c9b-46ac1aa6316a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:41.936414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:41.937013 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:41.937294 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:41.937569 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:41.938379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=31637686134042eb8b062f4e01dafa26, user.id=b77279a71bf2487fb0802c0c082b7ef3) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:41.938689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:41.940110 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cfcb15-0f60-4e54-8828-fd3cfda9d3c6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:41.946262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 584/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:41 2022] GET /identity/v3/role_assignments?user.id=b77279a71bf2487fb0802c0c082b7ef3&scope.project.id=31637686134042eb8b062f4e01dafa26&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:43.978558 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3169a3-9621-479c-b9d2-916513cd90a4 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:43.979088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3169a3-9621-479c-b9d2-916513cd90a4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:43.979088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3169a3-9621-479c-b9d2-916513cd90a4 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:43.980465 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 578/1162] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:43.985758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:43.986176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:43.986325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:44.002911 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:44.004085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:44.058531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:44.068447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 585/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:44.091260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3169a3-9621-479c-b9d2-916513cd90a4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:44.188230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3169a3-9621-479c-b9d2-916513cd90a4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:44.213934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:44.221200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:44.226559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:44.226559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:44.226559 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:44.287537 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:44.288940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:44.384122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 579/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:44.390039 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:44.484528 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d74e0a-8dde-4378-ac23-a6ade3c31f90 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:44.517032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:44.517821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:44.518103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:44.518377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:44.525547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:44.526979 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-e1aebba3-0c6c-45ca-822b-46615fd8b4cc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:44.540939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:44.542173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:25:44.543026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 586/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:25:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:44.547793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:44.574475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:44.643495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f67a7-7b51-4dba-83d3-b7fd52fe77d9 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:44.676222 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:44.676906 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:44.677183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:44.677451 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:44.678154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:44.678453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:44.680279 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033acfd-b276-4b57-8647-40bba525ee0c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:44.687184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 580/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:25:44 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:46.683919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2ee2-4af9-4ac2-af11-009c3e0d193e None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:46.684487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2ee2-4af9-4ac2-af11-009c3e0d193e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:46.684487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2ee2-4af9-4ac2-af11-009c3e0d193e None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:46.685849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 587/1167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:46.691006 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c3c2-0887-4810-849d-e10e826b208b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:46.691410 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c3c2-0887-4810-849d-e10e826b208b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:46.691561 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786c3c2-0887-4810-849d-e10e826b208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:46.707694 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-f786c3c2-0887-4810-849d-e10e826b208b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:46.708888 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f786c3c2-0887-4810-849d-e10e826b208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:46.772961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 581/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:46.795895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2ee2-4af9-4ac2-af11-009c3e0d193e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:46.849244 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:46.895009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2ee2-4af9-4ac2-af11-009c3e0d193e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:46.926965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:46.927606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:46.927893 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:46.928168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:46.928929 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:46.930812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88db166-9975-4af4-8293-971e19d080eb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:47.008357 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 588/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Jun 29 22:25:46 2022] POST /identity/v3/domains => generated 267 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:25:49.037342 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354343a-9bfd-4c00-a849-65ebac82570e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:49.037923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354343a-9bfd-4c00-a849-65ebac82570e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:49.037923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354343a-9bfd-4c00-a849-65ebac82570e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:49.039290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 582/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:49.044308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:49.044839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:49.044939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:49.061018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:49.062167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:49.125744 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:49.149772 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354343a-9bfd-4c00-a849-65ebac82570e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:49.173127 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:49.248861 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354343a-9bfd-4c00-a849-65ebac82570e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:49.281339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:49.282180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:49.282460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:49.282733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] PATH_INFO: `/v3/domains/f14341f3c16349f28bc7914eeb0d2be2` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:49.292921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f14341f3c16349f28bc7914eeb0d2be2)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:49.294290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c87a9a-d19d-4c49-b134-5b9b3f98cfd9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:49.295891 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 583/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 22:25:49 2022] GET /identity/v3/domains/f14341f3c16349f28bc7914eeb0d2be2 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:49.301651 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:49.343326 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:49.397678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231e28b-c8ee-4b3a-b4dc-f2d85eeeea3f None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:49.429085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:49.430240 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:49.430517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:49.430787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:49.431488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:49.432930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62139ca2-2377-4a5f-a481-b77df4dff958 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:49.505040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 590/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:25:49 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:51.535139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07203f95-73b8-4b10-8732-74b8d6f0297c None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:51.535650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07203f95-73b8-4b10-8732-74b8d6f0297c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:51.535650 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07203f95-73b8-4b10-8732-74b8d6f0297c None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:51.537061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 584/1174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:51.542711 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:51.543150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:51.543251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:51.559990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:51.561184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:51.625103 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 591/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:51.650180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07203f95-73b8-4b10-8732-74b8d6f0297c None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:51.729964 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:51.748604 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07203f95-73b8-4b10-8732-74b8d6f0297c None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:51.781202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:51.782044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:51.782329 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:51.782605 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] PATH_INFO: `/v3/domains/f14341f3c16349f28bc7914eeb0d2be2` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:51.783768 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=f14341f3c16349f28bc7914eeb0d2be2)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:51.785264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf55c-088f-4b10-9b9d-a6e2ac66beaa None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:51.786803 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 585/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 22:25:51 2022] GET /identity/v3/domains/f14341f3c16349f28bc7914eeb0d2be2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:51.792869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:51.816709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:51.888379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d44dc-ae91-4099-a3ab-113e4942ce76 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:51.920496 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:51.921155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:51.921434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:51.921708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:51.922403 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:51.923826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8a0c8-a320-45d5-9fe0-511cc4e6270f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:52.027419 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 592/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:25:51 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:25:54.077299 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6b79-def0-485d-abf1-1e327cfdb1dd None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.077859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6b79-def0-485d-abf1-1e327cfdb1dd None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.077859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6b79-def0-485d-abf1-1e327cfdb1dd None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.079196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 586/1178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:54.084319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.084749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.084946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.101757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:54.102920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:54.166297 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 593/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:54.190263 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6b79-def0-485d-abf1-1e327cfdb1dd None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:54.287816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6b79-def0-485d-abf1-1e327cfdb1dd None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:54.320536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:54.321302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.321584 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.321858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.331674 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:54.339067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:54.340217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:54.341350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 587/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:54.346142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:54.357861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:54.441675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200352b4-9c17-44b5-b67d-79b78a3abd02 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:54.473724 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:54.474369 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.474652 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.474926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.475659 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:54.476567 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:54.477933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:54.485653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 594/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:54.491530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:54.503782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:54.587486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f55e2-cabd-46e0-b270-ace4950226b5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:54.619990 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:54.620857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.621138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.621406 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] PATH_INFO: `/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.634397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] RBAC: Authorizing `identity:get_user(user_id=10063b1ff7634e59a4c1e85ed8e3e8b3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:54.635822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:54.637460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 588/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:54 2022] GET /identity/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:54.643159 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:54.715608 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:54.744157 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04db87-b711-4aeb-bd7b-dcb5087766cb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:54.775964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:54.776624 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:54.776909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:54.777189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:54.842759 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:54.844236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:54.910093 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:54.940503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 595/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:25:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:25:54.946997 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:55.010738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:55.042953 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542df70-8374-49bb-8dd2-5c232f2fd425 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:55.077968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:55.078813 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:55.079093 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:55.079369 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] PATH_INFO: `/v3/projects/bf50e336e82a4fc2827f74d056a94001` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:55.080653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] RBAC: Authorizing `identity:get_project(project_id=bf50e336e82a4fc2827f74d056a94001)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:55.082389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fb873-06a8-4651-bfc8-b7d31fa60353 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:55.084236 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 589/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:54 2022] GET /identity/v3/projects/bf50e336e82a4fc2827f74d056a94001 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:55.090495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:55.191775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040db3b1-56d6-4632-a31f-e223d2c9f455 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:55.227642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:55.228291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:55.228603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:55.228885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:55.229714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=bf50e336e82a4fc2827f74d056a94001, user.id=10063b1ff7634e59a4c1e85ed8e3e8b3) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:55.230017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:55.231449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba313ab-05d2-4a20-b924-21e1a286b0e9 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:55.236896 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 596/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:25:55 2022] GET /identity/v3/role_assignments?user.id=10063b1ff7634e59a4c1e85ed8e3e8b3&scope.project.id=bf50e336e82a4fc2827f74d056a94001&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:57.204166 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68dbc-b254-4dfd-96b7-873b50633795 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.204649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68dbc-b254-4dfd-96b7-873b50633795 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.204742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd68dbc-b254-4dfd-96b7-873b50633795 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.206103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 590/1186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:25:57.212308 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.212771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.212873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.229000 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:25:57.230161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:25:57.257848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:57.293996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 597/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:25:57.316396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd68dbc-b254-4dfd-96b7-873b50633795 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:57.414052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd68dbc-b254-4dfd-96b7-873b50633795 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:57.447262 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:57.447972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.448258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.448565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.451099 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:57.458869 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:25:57.466449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:25:57.467545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:25:57.468639 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 591/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:25:57.473710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:57.568170 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14bc703-25d7-4b0f-b5a8-ffd049388ecb None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:57.600578 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:57.601278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.601562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.601838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.602572 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:25:57.602879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:57.604238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:57.611980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 598/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:25:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:57.618462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:57.714541 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ac854-6c36-4b13-8de1-3a4eb743d905 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:57.746742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:57.747592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.747877 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.748152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] PATH_INFO: `/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.749354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] RBAC: Authorizing `identity:get_user(user_id=10063b1ff7634e59a4c1e85ed8e3e8b3)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:57.750765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:57.752352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 592/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:25:57 2022] GET /identity/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:25:57.758378 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:57.786319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:57.855683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99dc3d-82f5-4961-bb7b-a6edc2ef3945 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:57.888112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:57.888984 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:57.889267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:57.889542 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] PATH_INFO: `/v3/projects/bf50e336e82a4fc2827f74d056a94001` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:57.890699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] RBAC: Authorizing `identity:get_project(project_id=bf50e336e82a4fc2827f74d056a94001)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:57.892122 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db696290-9e7e-4b92-8899-4fc3795cdc9a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:57.893820 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 599/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:25:57 2022] GET /identity/v3/projects/bf50e336e82a4fc2827f74d056a94001 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:25:57.900505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:25:57.960726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:25:57.997523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaa31-aa49-46cd-852e-04348e4341e5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:25:58.030154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:25:58.031022 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:25:58.031306 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:25:58.031583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] PATH_INFO: `/v3/projects/bf50e336e82a4fc2827f74d056a94001/users/10063b1ff7634e59a4c1e85ed8e3e8b3/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:25:58.033530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf50e336e82a4fc2827f74d056a94001, user_id=10063b1ff7634e59a4c1e85ed8e3e8b3, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:25:58.034946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15a29-8bbd-42e0-9f00-a4261e824d37 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:25:58.120795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 593/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:25:57 2022] PUT /identity/v3/projects/bf50e336e82a4fc2827f74d056a94001/users/10063b1ff7634e59a4c1e85ed8e3e8b3/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:26:00.106203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205761-c1f9-4314-b30d-8c943deb04da None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.106755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205761-c1f9-4314-b30d-8c943deb04da None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.106755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205761-c1f9-4314-b30d-8c943deb04da None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.108095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 600/1193] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:26:00.113131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.113551 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.113683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.130183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:26:00.131380 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:26:00.198217 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 594/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:26:00.222283 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205761-c1f9-4314-b30d-8c943deb04da None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:00.312423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:00.318791 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205761-c1f9-4314-b30d-8c943deb04da None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:00.352163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:00.352966 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.353254 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.353534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.363380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:26:00.371116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:26:00.372203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:26:00.373278 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 601/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:26:00.378036 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:00.431357 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:00.473338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b534-0a83-4e41-922b-0a725af45f13 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:00.506411 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:00.507603 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.507885 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.508160 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.508930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:26:00.509237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:26:00.510599 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:26:00.518360 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 595/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:26:00.523855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:00.620143 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611bbb8-8208-4314-a729-f9610547e32b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:00.652543 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:00.653393 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.653673 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.653946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] PATH_INFO: `/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.655105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] RBAC: Authorizing `identity:get_user(user_id=10063b1ff7634e59a4c1e85ed8e3e8b3)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:26:00.656674 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:26:00.658267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 602/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:26:00 2022] GET /identity/v3/users/10063b1ff7634e59a4c1e85ed8e3e8b3 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:26:00.664305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:00.759183 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1522c-78ec-4a6a-a522-80f28b6cb258 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:00.774622 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:00.791786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:00.792528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:00.792816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:00.793087 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:00.857003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:26:00.858422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:26:00.950786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 596/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:26:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:26:00.956510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:00.986927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:01.058646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4649a-b593-4137-8a68-1a20af4d6d39 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:01.091546 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:01.092387 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:01.092695 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:01.092971 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] PATH_INFO: `/v3/projects/bf50e336e82a4fc2827f74d056a94001` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:01.094150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] RBAC: Authorizing `identity:get_project(project_id=bf50e336e82a4fc2827f74d056a94001)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:26:01.095571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22ee4-eeca-4157-9037-ad23dd2a4092 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:26:01.097284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 603/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:26:00 2022] GET /identity/v3/projects/bf50e336e82a4fc2827f74d056a94001 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:26:01.103440 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:26:01.120295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:01.200061 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ec620-6e78-406e-bfcb-bc8f7011914f None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:26:01.231781 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:26:01.232375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:26:01.232665 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:26:01.232938 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:26:01.233834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=bf50e336e82a4fc2827f74d056a94001, user.id=10063b1ff7634e59a4c1e85ed8e3e8b3) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:26:01.234143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:26:01.235542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72866b-ea42-40e2-9c5d-65da99596e15 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:26:01.241876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 597/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:26:01 2022] GET /identity/v3/role_assignments?user.id=10063b1ff7634e59a4c1e85ed8e3e8b3&scope.project.id=bf50e336e82a4fc2827f74d056a94001&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:26:11.087532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=54 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:26:11.238598 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=60 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:13.796153 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af91a-811a-481a-8d83-34172ffe9195 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:13.796771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af91a-811a-481a-8d83-34172ffe9195 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:13.796771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7af91a-811a-481a-8d83-34172ffe9195 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:13.798102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 604/1201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:13.803272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:13.803700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:13.803826 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:13.820947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:13.822106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:13.886703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 598/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:13.912565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af91a-811a-481a-8d83-34172ffe9195 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:14.014865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7af91a-811a-481a-8d83-34172ffe9195 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:14.049100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:14.049823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:14.050109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:14.050386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:14.060262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:14.061769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:14.078951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:14.080119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:14.081508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:14.081508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:14.081508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:14.081508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:14.081508 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 605/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:14.086749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:14.182796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da41c9-6ffa-411e-9e2c-59b9584a6935 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:14.214239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:14.219844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:14.220526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:14.220805 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:14.221075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:14.221782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:14.222081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:14.223422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a6f4-7970-4525-95ee-892c7d4231bf None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:14.234196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 599/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:14.240179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:14.296769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:14.342364 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465e57b-afda-4f70-85dc-683b536f3e29 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:14.374373 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:14.375048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:14.375541 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:14.376328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:14.377076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:14.378519 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332fbd-2758-4bdd-bc4b-3e80791770b0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:14.517398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 606/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:27:14 2022] POST /identity/v3/users => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:27:16.568633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7313-cff0-43e1-ba1a-95d7603636e6 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:16.569203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7313-cff0-43e1-ba1a-95d7603636e6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:16.569203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de7313-cff0-43e1-ba1a-95d7603636e6 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:16.570568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 600/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:16.575661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:16.576085 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:16.576217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:16.592709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:16.595922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:16.662099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:16.686786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de7313-cff0-43e1-ba1a-95d7603636e6 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:16.785290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de7313-cff0-43e1-ba1a-95d7603636e6 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:16.819761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:16.820514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:16.820801 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:16.821075 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:16.831562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:16.839910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:16.843733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:16.844818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 601/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:16.847090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:16.887006 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:16.945298 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ccf8ba-4b55-4e7b-8584-6444ac0b28a9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:16.978335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:16.978988 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:16.979267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:16.979539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:16.980266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:16.980594 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:16.981954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:16.989730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 608/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:16.995419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.043823 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:17.092286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33d484-0285-4a1b-aec3-7ffbda7c536b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:17.125859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:17.126625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:17.126904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:17.127174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:17.137556 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:17.138973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:17.157260 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:17.158204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:17.159220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:17.159220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:17.159220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:17.159220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:17.159220 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 602/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:17.164205 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.259554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:17.262381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf3419-390e-41a6-9e76-8687b6aa934a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:17.294818 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:17.295471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:17.295754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:17.296046 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:17.296777 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:17.297082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:17.298454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:17.309277 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 609/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:17.315118 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.412177 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4ed50-4dab-453b-8459-9ca7fbddcf5b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:17.413808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:17.445892 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:17.446673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:17.446951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:17.447221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:17.454116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:17.455562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:17.471453 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:17.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:17.473635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 603/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:17.478573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.578109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7e5d1-4ad8-4493-a9e2-788f29ca2d08 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:17.610161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:17.610913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:17.611198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:17.611475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:17.612584 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:17.616058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:17.616058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:17.631536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 610/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:17.637812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.733133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975b366-ef9e-4870-a383-fa11f344d640 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:17.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:17.767349 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:17.767629 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:17.767901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:17.796930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:17.832123 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:17.833635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:17.929573 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 604/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:27:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:27:17.935407 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:17.954319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:18.033030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857fc81-0d41-4443-99f7-394cd1bb7d4e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:18.065694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:18.066474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:18.066758 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:18.067027 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:18.077554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:18.079004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:18.096629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:18.097771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:18.098886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:18.098886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:18.098886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:18.098886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:18.098886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 611/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:18.103459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:18.164755 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:18.202600 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194f1fc-9452-4fdc-83fc-4155918da3ef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:18.235486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:18.236133 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:18.236436 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:18.236718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:18.237683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:18.237985 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:18.239351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:18.250337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 605/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:18.256104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:18.325748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:18.355652 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b906d-106f-43e8-a44c-2e487c3228fe None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:18.388571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:18.389344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:18.389622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:18.389890 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:18.396574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:18.398104 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:18.412613 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:18.413699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:18.414994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 612/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:18.419620 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:18.517757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ea59c-32f8-41b9-861c-18e78c892101 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:18.539174 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:18.550654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:18.551297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:18.551583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:18.551856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:18.552667 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:18.552971 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:18.554930 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a858200-e95f-495e-ac5c-10554404dae4 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:18.566557 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 606/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:18.573146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:18.671710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc513616-54e5-4c84-8f00-9b0bfe1553ee None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:18.699184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:18.704895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:18.705534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:18.705817 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:18.706089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:18.706903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ef99546296c94b1886157c43f82fc315) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:18.707220 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:18.708666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f0aa7-3f76-4823-8517-98761a19bf9f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:18.714474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 613/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:27:18 2022] GET /identity/v3/role_assignments?user.id=ef99546296c94b1886157c43f82fc315&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:27:20.720808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10494-cd64-4bb2-89b7-0607aabda82e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:20.721465 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10494-cd64-4bb2-89b7-0607aabda82e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:20.721465 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d10494-cd64-4bb2-89b7-0607aabda82e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:20.722718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 607/1220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:20.728583 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:20.728983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:20.729135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:20.745520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:20.746677 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:20.810850 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:20.833107 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d10494-cd64-4bb2-89b7-0607aabda82e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:20.932552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d10494-cd64-4bb2-89b7-0607aabda82e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:20.967430 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:20.968209 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:20.968521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:20.968795 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:20.985879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:20.986065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:20.987487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:20.988474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 608/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:20.993779 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.090257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26a6d7-3941-4275-b90b-0a9b5310441b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.112892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:21.123008 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.123660 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.126745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.126745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.126745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] RBAC: Adding query filter params (name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:21.126745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.126745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.134698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 615/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:27:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:21.140393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.182973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:21.238486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70240eb-434c-4248-965f-6ae58ac839ef None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.271084 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.271852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.272131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.273041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.283120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.284569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:21.300908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:21.301925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:21.302876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:21.302876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:21.302876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:21.302876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:21.302876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 609/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:21.308454 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.405942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717c01-7911-4502-aa6b-5f8d71c47725 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.438952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b76c4-0591-4774-8506-445bad8239be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.439603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b76c4-0591-4774-8506-445bad8239be None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.439886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b76c4-0591-4774-8506-445bad8239be None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.440163 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b76c4-0591-4774-8506-445bad8239be None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.440912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b76c4-0591-4774-8506-445bad8239be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:21.441229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b76c4-0591-4774-8506-445bad8239be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.442597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b76c4-0591-4774-8506-445bad8239be None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.454645 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 616/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:21.460384 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.554128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:21.561076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fd91a-8d61-4d5b-b367-c36aa60b08c8 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.593879 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.594660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.594937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.595207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.602761 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.606344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:21.619076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:21.620339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:21.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 610/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:21.626176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b76c4-0591-4774-8506-445bad8239be None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.671981 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:21.723195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b76c4-0591-4774-8506-445bad8239be None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.756655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.757313 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.757591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.757861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.758678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:21.758982 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.760420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.776826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 617/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:27:21.782489 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:21.879765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a262-7c3c-47ef-87f6-95976955ac5d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:21.911437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:21.912207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:21.912514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:21.913286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:21.923356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:21.924803 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:21.942097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:21.943172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:21.944111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:21.944111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:21.944111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:21.944111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:21.944111 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 611/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:21.948989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:22.046398 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeccfc-df79-49e1-96bf-c1c2b659ab8b None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:22.048709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:22.078084 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:22.078733 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:22.079018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:22.079295 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:22.080001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:22.080306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:22.081703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:22.093505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 618/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:22.099109 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:22.108968 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:22.196379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89087ca-e057-4acb-9d31-b38900cd45f2 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:22.230508 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:22.231291 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:22.231611 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:22.231880 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:22.238917 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:22.242738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:22.255216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:22.256303 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:22.263191 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 612/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:27:22.263831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:22.360114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4be4d-9ef1-43f8-9242-484fbb348b4e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:22.393041 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:22.393698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:22.393968 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:22.394251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:22.395022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:22.395328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:22.396771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10353841-7a5e-4b88-84a9-4f5d393acf74 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:22.408861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 619/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:22.414857 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:22.481796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:22.515215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d2042-656b-4f77-80a1-9c6312e965c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:22.549233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:22.550106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] REQUEST_METHOD: `PUT` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:22.550396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:22.550648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ef99546296c94b1886157c43f82fc315/roles/7d0845c6babb42c183eca72c293fe0a0` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:22.564591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=ef99546296c94b1886157c43f82fc315, role_id=7d0845c6babb42c183eca72c293fe0a0)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:22.569589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9eca3-b9ed-475b-ae2f-0a4894fa99ba None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:22.657196 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 613/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:27:22 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ef99546296c94b1886157c43f82fc315/roles/7d0845c6babb42c183eca72c293fe0a0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:27:24.669951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35c8b-8c6a-427a-839a-a37b0d041d28 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:24.670473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35c8b-8c6a-427a-839a-a37b0d041d28 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:24.670590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b35c8b-8c6a-427a-839a-a37b0d041d28 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:24.671871 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 620/1233] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:24.677104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:24.677521 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:24.677663 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:24.694332 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:24.699905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:24.761010 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:24.784636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b35c8b-8c6a-427a-839a-a37b0d041d28 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:24.809922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:24.884849 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b35c8b-8c6a-427a-839a-a37b0d041d28 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:24.918770 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:24.919546 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:24.919828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:24.920165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:24.930371 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:24.937995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:24.939089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:24.940007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 621/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:24.945120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:24.990438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:25.042168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8517666-caa7-4359-9094-d5949d5e0676 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.073903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.074563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.074844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.075128 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.075851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:25.076155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.077550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:25.086103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 615/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:25.091782 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:25.175031 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:25.191321 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad74ad-61d6-4620-86f0-d4143844422a None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.224552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.225940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.226219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.226489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.236045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.237777 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:25.255404 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:25.260996 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:25.262030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:25.262030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:25.262030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:25.262030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:25.262030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 622/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:27:25.262482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:25.360462 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1e9d9-04d5-4984-bcf6-3a1d37a1e4a6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.369822 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:25.394484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.395136 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.395417 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.395687 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.396412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:25.396766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.399134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:25.410868 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 616/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:25.416822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:25.513903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af9d92-fcb9-4b6b-b1f5-34a1d7eafb12 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.547090 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.547864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.548139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.548433 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.551089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:25.555513 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.556995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:25.571831 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:25.573017 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:25.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 623/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:25.578994 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:25.677251 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599b2d0-9bc0-4bb7-8f5f-d2db18a1854b None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.710138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.710786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.711065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.711337 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.712157 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:25.712483 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.713889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:25.731577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 617/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:25.737563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:25.836334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd54bd-0866-4d3d-b2c4-98a14b64ee84 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:25.869668 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:25.870301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:25.870582 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:25.870852 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:25.929462 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:25.935717 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:25.937179 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.037438 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:27:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:27:26.039222 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:26.065900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:26.136098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b010e-7c1a-4fed-bc64-9156a0caf362 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:26.168283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:26.169086 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:26.169366 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:26.169636 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:26.180396 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:26.181931 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:26.200817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:26.202003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:26.202937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:26.202937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:26.202937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:26.202937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:26.202937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 618/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:26.207726 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:26.299149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:26.304627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c4661-ce73-4467-8aba-86111e08669f None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:26.337743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:26.338391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:26.338672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:26.338947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:26.339654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:26.339961 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:26.341348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.352086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 625/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:26.357808 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:26.433657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:26.454338 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405700-2dc1-427c-86b5-bb14d9057309 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:26.486533 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:26.487602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:26.487884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:26.488159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:26.494619 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:26.496047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:26.509846 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:26.510834 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:26.511771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 619/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:26.516962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:26.614020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36dc11-9a4d-4123-91de-a33b4ab90952 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:26.646678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:26.647352 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:26.647637 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:26.647913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:26.648712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:26.649020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:26.650460 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d717c0-3a51-4ce0-bef9-d0bb787239d1 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.661954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 626/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:26.668213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:26.766677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed5a5a-63e1-42fa-aeed-68882dc9db69 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:26.798237 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:26.798875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:26.799155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:26.799431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:26.800280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] RBAC: Adding query filter params (role.id=7d0845c6babb42c183eca72c293fe0a0, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ef99546296c94b1886157c43f82fc315) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:26.800633 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:26.802054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456d446-0966-4f61-8994-6f0484c5c71a None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:26.808194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 620/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:27:26 2022] GET /identity/v3/role_assignments?user.id=ef99546296c94b1886157c43f82fc315&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=7d0845c6babb42c183eca72c293fe0a0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:28.882022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674b20-0406-47df-89d3-ba2b0886c8c9 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:28.882573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674b20-0406-47df-89d3-ba2b0886c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:28.882573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c674b20-0406-47df-89d3-ba2b0886c8c9 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:28.883941 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 627/1247] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:28.889098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:28.889484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:28.889649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:28.894577 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:28.906416 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:28.907574 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:28.971195 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:28.996076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c674b20-0406-47df-89d3-ba2b0886c8c9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.014456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:29.094241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c674b20-0406-47df-89d3-ba2b0886c8c9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.127005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.128960 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.129245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.129517 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.140284 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:29.147804 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:29.148938 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:29.149967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 628/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:29.155116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.252077 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34255eb2-461f-431d-81d7-0c2021508e13 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.279914 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:29.284605 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.285254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.285529 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.285799 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.286528 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:29.286827 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:29.288788 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:29.296562 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 622/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:29.302310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.379414 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:29.401188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5b0fb-fa2c-4e2b-8421-76dfa72cb870 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.434012 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.434787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.435068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.435346 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.445335 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:29.446848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:29.463390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:29.464489 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:29.465769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:29.465769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:29.465769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:29.465769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:29.465769 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 629/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:29.470379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.568793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce6984-b1f5-4501-8c22-c7b94acd6e5c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.601927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.602568 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.602845 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.603116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.603818 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:29.604116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:29.605492 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:29.617255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 623/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:29.622954 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.722239 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f207d3-81dc-4588-88d2-ac8becd6742c None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.748146 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:29.755604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.756418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.756709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.756987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.764166 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:29.765646 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:29.780099 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:29.781233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:29.782606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 630/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:29.787190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:29.841838 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:29.884653 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a4683-ad54-425f-bc03-54723b73be35 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:29.916724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:29.917382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:29.917682 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:29.917936 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:29.918756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:29.919062 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:29.920512 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:29.936749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 624/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:29.942441 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.042246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7873-9d26-4e43-a2f4-bf92d6b7a2ee None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:30.074459 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:30.075087 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:30.075367 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:30.075639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:30.129338 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:30.141472 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:30.142897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:30.241453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:27:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:27:30.247368 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.344753 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa611-0482-4f4a-9390-c77fcb534569 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:30.357825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:30.378954 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:30.379739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:30.380021 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:30.380330 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:30.390703 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:30.392139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:30.409946 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:30.411043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:30.412256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:30.412256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:30.412256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:30.412256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:30.412256 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 625/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:30.417127 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.502301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:30.514666 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f6a0-f071-4354-9740-e4258ac40d52 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:30.546585 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:30.547232 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:30.547516 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:30.547789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:30.548520 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:30.548825 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:30.550266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:30.561774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 632/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:30.567371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.666851 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30867982-967d-4a78-b59a-f1ebbebdc284 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:30.700110 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:30.700911 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:30.701189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:30.701457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:30.707901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:30.709497 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:30.723560 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:30.725197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:30.726289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 626/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:30.731161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.829695 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c21c89-ec9e-40c2-b413-149cf713990e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:30.862233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:30.862907 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:30.863187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:30.866238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] PATH_INFO: `/v3/projects` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:30.866238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:30.866238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:30.866649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f360ff-cd5b-4160-a9d8-9529aa411bcd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:30.878304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 633/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:30.884473 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:30.910377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:30.982731 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986530ca-2857-48d4-abe5-c4b26cf402ae None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:31.015461 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:31.016092 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:31.016371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:31.016678 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:31.017484 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ef99546296c94b1886157c43f82fc315) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:31.017793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:31.019328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615d5c4-63c1-4f60-9000-612d2659d72b None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:31.025047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 627/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:27:30 2022] GET /identity/v3/role_assignments?user.id=ef99546296c94b1886157c43f82fc315&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:33.032756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad440-2d78-4c6a-8a67-43360f70b6d1 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.033327 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad440-2d78-4c6a-8a67-43360f70b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.033423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caad440-2d78-4c6a-8a67-43360f70b6d1 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.034708 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 634/1261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:33.040438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.040843 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.044447 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.057770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:33.058927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:33.123374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 628/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:33.146089 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad440-2d78-4c6a-8a67-43360f70b6d1 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:33.156940 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:33.245518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caad440-2d78-4c6a-8a67-43360f70b6d1 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:33.278972 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:33.279764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.280045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.280329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.290993 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:33.298478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:33.299682 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:33.300934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 635/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:33.305766 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:33.323609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:33.401871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90988178-a2a8-46bb-8e58-4fc1513f62e7 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:33.435210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:33.435867 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.436181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.436483 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.437227 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:33.437530 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:33.438916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:33.446722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 629/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:33.452468 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:33.519004 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:33.552432 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae8537-cf6a-4d3a-be14-fe006ee64bdb None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:33.585007 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:33.585789 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.586072 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.586348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.597865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:33.599332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:33.618842 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:33.619830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:33.620811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:33.620811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:33.620811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:33.620811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:33.620811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 636/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:33.625944 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:33.706106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:33.727371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f689a9d-c384-4e40-b870-d966265eb7b5 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:33.759917 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:33.760594 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.760928 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.761194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.761910 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:33.762210 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:33.763550 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:33.775702 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 630/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:27:33.781453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:33.879133 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9bfd8-c1ce-4f6a-9a8b-941db2ea6107 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:33.899178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:33.912702 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:33.913491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:33.913775 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:33.914051 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:33.921475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:33.926214 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:33.936994 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:33.938198 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:33.939151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 637/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:33.944500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.044803 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a0fbf-2a78-4987-aed5-a4c5c3597e67 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.078020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.078700 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.078980 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.079252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] PATH_INFO: `/v3/users` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.080072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:34.080372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.081812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:34.090181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:34.098331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 631/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:34.104129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.204276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ddb9f-e8d9-4e75-838f-0a107babc8a3 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.236041 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.237086 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.237362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.237630 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.248319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.249773 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:34.266975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:34.267878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:34.268867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:34.268867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:34.268867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:34.268867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:34.268867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 638/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:34.274685 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.373535 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fa67b-4fe4-49fa-9d22-256e24287e9d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.406267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.406948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.407232 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.407508 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.408215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:34.408565 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.409918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:34.421480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 632/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:34.427218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.458947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:34.525245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90046d62-012a-4ccd-a82c-4c4f499a558e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.560149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.560964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.561249 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.561547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.568282 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.569757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:34.583218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:34.584434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:34.585422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 639/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:34.590343 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.648189 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:34.688089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7e7b5-fc7e-40f4-ad7f-32527845a2c6 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.721181 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.722032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.722618 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.723402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.724197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:34.725063 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.727286 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0fc51f-d06f-4161-82a9-2913b85d5224 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:34.738897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 633/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:34.745581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:34.841014 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:34.849262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c7d2b-213f-4889-b057-ceca096ae94e None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:34.882325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:34.883196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:34.883475 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:34.883748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] PATH_INFO: `/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ef99546296c94b1886157c43f82fc315/roles/c357b075e24d4b99a3fa53871c7a0201` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:34.885704 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e4cc8fea9f74d6c9c336e41d65baf97, user_id=ef99546296c94b1886157c43f82fc315, role_id=c357b075e24d4b99a3fa53871c7a0201)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:34.887114 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed017b37-0687-4511-9c73-4657e1b1bea5 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:35.000655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 640/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:27:34 2022] PUT /identity/v3/projects/7e4cc8fea9f74d6c9c336e41d65baf97/users/ef99546296c94b1886157c43f82fc315/roles/c357b075e24d4b99a3fa53871c7a0201 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:27:36.992569 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732b72-9294-4222-a6a5-1143fec2c2f5 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:36.993150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732b72-9294-4222-a6a5-1143fec2c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:36.993150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c732b72-9294-4222-a6a5-1143fec2c2f5 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:36.994524 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 634/1274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:36.999861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.000262 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.000439 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.017342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:37.018519 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:37.083488 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 641/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:37.107025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c732b72-9294-4222-a6a5-1143fec2c2f5 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.206743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c732b72-9294-4222-a6a5-1143fec2c2f5 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:37.224069 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:37.241147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:37.241934 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.242215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.242485 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.252297 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:27:37.260377 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:37.264139 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:37.265233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 635/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:37.267655 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.345325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:37.362619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74638f19-b797-462d-a4c4-1055b70daeff None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:37.395506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:37.396181 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.396506 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.396771 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] PATH_INFO: `/v3/roles` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.397510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:37.397815 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:37.399183 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:37.406872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 642/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:37.413088 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.511572 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7fc3-08fb-403d-a67a-5fb0248c1443 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:37.543785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:37.544593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.544875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.545148 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.556121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:37.557597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:37.574413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:37.575475 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:37.576609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:37.576609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:37.576609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:37.576609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:37.576609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 636/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:37.581341 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.680296 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988f255-1ddf-49ed-886c-b9bbfc86e386 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:37.712767 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:37.713417 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.713699 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.713975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] PATH_INFO: `/v3/domains` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.714680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:37.714983 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:37.716342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:37.728503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 643/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:37.734255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.765368 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:37.831817 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017598-9581-42de-8630-5b44bdc7b8c7 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:37.865052 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:37.865835 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:37.866153 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:37.866425 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:37.874520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:37.876050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:27:37.889999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:37.891120 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:37.892258 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 637/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:37.897588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:37.901386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:37.994458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb23f12-bc55-4184-85e8-047311567491 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.026868 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.027471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.027751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.028023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] PATH_INFO: `/v3/users` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.028874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:38.031301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.031301 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.047689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 644/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:27:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:27:38.053564 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:38.140959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:38.150576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f40e7-8da7-453e-8a00-ac9a9e2eb838 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.182049 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.182684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.182963 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.183233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.252235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.253776 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.340884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:38.350847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 638/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:27:38.356747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:38.417306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:38.454967 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f36a1-4c14-41d2-9a5f-7c91bba72b49 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.487380 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.488202 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.488731 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.489052 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.499819 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.501293 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:27:38.518442 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:38.519507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:38.527233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:27:38.527233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:27:38.527233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:27:38.527233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:38.527233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 645/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:38.527609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:38.620147 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5b79d-edf1-4700-a9e3-07125dd4e431 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.652821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.653459 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.653739 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.653999 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] PATH_INFO: `/v3/domains` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.654746 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:38.655043 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.656381 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.667203 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 639/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:38.672886 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:38.770135 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2fb4-7cc8-4c42-9455-9024311b41c6 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.783119 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:38.802848 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.803625 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.803904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.804177 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.810604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.812023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:27:38.826260 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:38.827299 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: ERROR keystone.server.flask.application Jun 29 22:27:38.828241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 646/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:38.833443 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:38.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:38.935420 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a258a-a1f0-493d-bd0c-bb847782908c None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:38.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:38.969013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:38.969296 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:38.969571 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:38.970346 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:38.970654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:38.972065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22413950-cd42-4a29-affd-556ee15b01d9 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:38.984317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 640/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:27:38.991325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:39.087436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc6e0e-b419-43c8-b474-0e87f83cfae0 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:39.122227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:39.122870 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:39.123157 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:39.123463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:39.124281 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] RBAC: Adding query filter params (role.id=c357b075e24d4b99a3fa53871c7a0201, scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97, user.id=ef99546296c94b1886157c43f82fc315) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:39.124627 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:39.126121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797c400-fea1-4a10-8945-0327a2f0f118 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:39.131903 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 647/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:27:38 2022] GET /identity/v3/role_assignments?user.id=ef99546296c94b1886157c43f82fc315&scope.project.id=7e4cc8fea9f74d6c9c336e41d65baf97&role.id=c357b075e24d4b99a3fa53871c7a0201 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:41.194155 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ade2-0974-40cf-9381-a4465ab92222 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:41.194644 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ade2-0974-40cf-9381-a4465ab92222 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:41.194758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ade2-0974-40cf-9381-a4465ab92222 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:41.196074 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 641/1288] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:41.201139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:41.201588 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:41.201730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:41.218935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:41.220121 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:41.249326 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:41.286601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 648/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:41.309244 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ade2-0974-40cf-9381-a4465ab92222 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:41.407654 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ade2-0974-40cf-9381-a4465ab92222 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:41.418630 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:41.440516 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:41.441235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:41.441514 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:41.441783 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:41.442413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:41.444309 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:41.455844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:41.456925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:41.457785 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:41.458793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 642/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:27:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:41.463754 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:41.560227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aad6ea-7af3-4003-93ee-b805d2b82caa None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:41.593316 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:41.593968 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:41.594253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:41.594530 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:41.595227 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:41.595533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:41.596948 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bd843-454b-4371-80fd-7916a5f31726 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:41.601766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 649/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:27:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:41.607728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:41.709073 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7c9f4-9852-4c4c-988c-b9d042ade34d None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:41.741180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:41.741821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:41.742097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:41.742366 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] PATH_INFO: `/v3/services` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:41.743054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:41.743355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:41.744722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03412982-2d3e-4826-8f85-f7145af83f61 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:41.749116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 643/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:27:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:43.783423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0107-69a4-401f-bdd9-b640a57671e6 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:43.783955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0107-69a4-401f-bdd9-b640a57671e6 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:43.783955 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0107-69a4-401f-bdd9-b640a57671e6 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:43.785381 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 650/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:43.791169 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8996b7-6cc7-4e05-9e1e-d03d21a17a63 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:43.791581 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8996b7-6cc7-4e05-9e1e-d03d21a17a63 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:43.791705 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8996b7-6cc7-4e05-9e1e-d03d21a17a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:43.808101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-bb8996b7-6cc7-4e05-9e1e-d03d21a17a63 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:43.809288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-bb8996b7-6cc7-4e05-9e1e-d03d21a17a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:43.837745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:43.874034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 644/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:43.897077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0107-69a4-401f-bdd9-b640a57671e6 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:43.927923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:43.995320 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0107-69a4-401f-bdd9-b640a57671e6 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:44.029963 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:44.030650 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:44.030928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:44.031201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:44.031919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:44.033310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0054ad-31c8-4d9c-99f3-d76bf98c21b7 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:44.105492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 651/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:27:43 2022] POST /identity/v3/services => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:27:46.130102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f848-2643-4343-ab92-1f8ccfed2992 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.131215 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f848-2643-4343-ab92-1f8ccfed2992 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.131314 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530f848-2643-4343-ab92-1f8ccfed2992 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.132657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 645/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:46.137936 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.138377 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.138523 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.154663 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:46.155827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:46.227867 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 652/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:27:46.251697 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530f848-2643-4343-ab92-1f8ccfed2992 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:46.350543 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530f848-2643-4343-ab92-1f8ccfed2992 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:46.384044 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:46.384787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.385065 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.385335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.385975 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:46.387317 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:46.398807 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:46.399960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:46.400855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 646/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:27:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:46.405923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:46.423945 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:46.500989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fe3bb-7484-4e17-b07e-9a6f1995b24f None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:46.534614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:46.535257 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.535539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.535808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.536599 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:46.537874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:46.539263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:46.544359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 653/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:27:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:46.550284 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:46.581255 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:46.647564 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155445fa-1214-4820-a95a-91e556ac7083 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:46.680958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:46.681745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.682026 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.682302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.683085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] RBAC: Adding query filter params (interface=public, service_id=c2b2557ab1ae4d008e784915e096a38d, region_id=RegionOne) {{(pid=80046) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:46.683397 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:46.684841 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd9279f-98ac-484c-a30f-7f4cee075fb1 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:46.689756 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 647/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:27:46 2022] GET /identity/v3/endpoints?service_id=c2b2557ab1ae4d008e784915e096a38d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:46.695573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:46.775269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:46.792808 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0470012-edb6-43e0-bf1f-819298b78aa2 None admin] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:46.824834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:46.825484 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:46.825765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:46.826040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:46.826707 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:46.828217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554979a-5f7d-4bc4-8522-701f9d9279c8 None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:46.835534 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 654/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:27:46 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:27:48.834030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a926-77c9-4682-821c-0b9bd65127ae None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:48.834585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a926-77c9-4682-821c-0b9bd65127ae None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:48.834585 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a926-77c9-4682-821c-0b9bd65127ae None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:48.835961 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 648/1302] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:27:48.841203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:48.841649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:48.841746 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:48.858639 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:27:48.859786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:27:48.924490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 655/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:27:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:27:48.949727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a926-77c9-4682-821c-0b9bd65127ae None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:49.044916 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:49.051350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a926-77c9-4682-821c-0b9bd65127ae None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:49.083906 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:49.084774 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:49.085010 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:49.085282 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:49.085926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:49.087283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:27:49.098951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:27:49.100804 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application with Lock( Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: ERROR keystone.server.flask.application Jun 29 22:27:49.101767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 649/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:27:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:27:49.106762 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:49.181957 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:49.204478 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb0ae1-7dab-4901-bafe-c07d63ce2e17 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:49.238919 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:49.239697 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:49.239978 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:49.240251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] PATH_INFO: `/v3/services` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:49.240977 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80047) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:27:49.241280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:49.242644 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8219d-df69-4826-b8db-9f55f2cd48fd None admin] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:49.247669 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 656/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:27:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:27:49.253368 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:27:49.351020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7551f-3bae-4c9a-93fc-0ae7643d1c77 None admin] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:27:49.384391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:27:49.385057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:27:49.385336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:27:49.385606 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:27:49.386323 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:27:49.387711 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62387a5-70f4-466a-a202-ec7c0499bc82 None admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:27:49.487125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 650/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:27:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:27:59.244680 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=30 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:27:59.482615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:33:57.471210 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc154c-864d-4af2-9779-639528a8ef52 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:33:57.471787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc154c-864d-4af2-9779-639528a8ef52 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:33:57.471787 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc154c-864d-4af2-9779-639528a8ef52 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:33:57.474108 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 657/1307] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:33:57.479298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699b6f-0b30-4e51-a826-68b4d3561cb6 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:33:57.479758 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699b6f-0b30-4e51-a826-68b4d3561cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:33:57.479842 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b699b6f-0b30-4e51-a826-68b4d3561cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:33:57.638450 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8b699b6f-0b30-4e51-a826-68b4d3561cb6 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:33:57.639592 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8b699b6f-0b30-4e51-a826-68b4d3561cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:33:57.807142 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 651/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:33:57.865473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:33:57.865749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:33:57.866298 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:33:57.868019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 658/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 22:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:33:57.884656 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee0ce-6452-428e-96d8-702b93836de1 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:33:57.885172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee0ce-6452-428e-96d8-702b93836de1 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:33:57.887836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ee0ce-6452-428e-96d8-702b93836de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:33:57.999164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1e0ee0ce-6452-428e-96d8-702b93836de1 None None] MFA Rules not processed for user `79e38a947d4a42f68cb6457ae2101234`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:33:58.001123 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1e0ee0ce-6452-428e-96d8-702b93836de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:33:58.033522 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:33:58.111319 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 652/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 22:33:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:33:58.112256 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:33:58.114168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:33:58.262465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0643f8a-fb33-4457-be67-49f13a3b79c4 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:33:58.343339 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:33:58.343997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:33:58.344291 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:33:58.344892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:33:58.346245 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:33:58.405495 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:33:58.462152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:33:58.463600 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e56062-73ea-4d12-99bf-91c31de73a77 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:33:58.483157 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 659/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 22:34:00.838117 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:00.838723 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:00.838723 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:00.840037 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 653/1312] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:00.845329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b42d-ad36-43da-ab99-00166eab4354 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:00.845748 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b42d-ad36-43da-ab99-00166eab4354 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:00.846013 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b42d-ad36-43da-ab99-00166eab4354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:00.915793 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-53a9b42d-ad36-43da-ab99-00166eab4354 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:00.917032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-53a9b42d-ad36-43da-ab99-00166eab4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:01.013058 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 660/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:01.051419 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:01.053047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:01.165058 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28465755-dfc8-4eb7-89cc-ce63bd63b003 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:01.239858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:01.242229 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:01.242886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:01.243173 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:01.243449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:01.245122 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:01.352214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:01.353694 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89cb8-c273-4b3c-81a6-6c77ed41b76a service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:01.373660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 654/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:03.881285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:03.881834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:03.881834 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:03.883215 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 661/1315] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:03.888335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86181-eef7-458a-8cfb-74c8cb5f1529 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:03.891583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86181-eef7-458a-8cfb-74c8cb5f1529 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:03.891583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca86181-eef7-458a-8cfb-74c8cb5f1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:03.957765 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7ca86181-eef7-458a-8cfb-74c8cb5f1529 None None] MFA Rules not processed for user `d6a901d47b174c20bc27a77db56745a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:03.958963 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7ca86181-eef7-458a-8cfb-74c8cb5f1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:04.009979 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:04.054344 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 655/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:04.094015 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:04.095535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:04.105774 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:04.197764 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0a96d-5c60-4974-b209-f37cb534b685 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:04.268944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:04.269589 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:04.269872 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:04.270147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:04.271760 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:04.331862 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:04.376336 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:04.378322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b811a-6a17-4eee-a050-199f9bb5652b service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:04.396718 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 662/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:07.245023 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:07.245542 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:07.245647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:07.246945 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 656/1318] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:07.252241 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43f4b-9223-4be1-89d2-956a7483f2d1 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:07.253216 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43f4b-9223-4be1-89d2-956a7483f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:07.253325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf43f4b-9223-4be1-89d2-956a7483f2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:07.317148 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-bcf43f4b-9223-4be1-89d2-956a7483f2d1 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:07.318326 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-bcf43f4b-9223-4be1-89d2-956a7483f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:07.411094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 663/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:07.449307 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:07.450810 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:07.553106 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49c538-16f5-4ffc-a06c-193edb228308 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:07.622760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:07.623389 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:07.623672 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:07.623948 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:07.625866 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:07.633660 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:07.730871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:07.732218 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb939c9-e6eb-4b5c-b59a-852913e462a9 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:07.750347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 657/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:10.801604 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:10.802139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:10.802139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:10.803526 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 664/1321] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:10.808648 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac770-4ec2-471c-a158-e9bf55f43ea5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:10.809054 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac770-4ec2-471c-a158-e9bf55f43ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:10.809207 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac770-4ec2-471c-a158-e9bf55f43ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:10.872787 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4bdac770-4ec2-471c-a158-e9bf55f43ea5 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:10.873967 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4bdac770-4ec2-471c-a158-e9bf55f43ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:10.932015 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:10.969154 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 658/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:11.007628 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:11.009714 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:11.031675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:11.124019 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347082d-db46-4d02-bb32-6f888c9ece47 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:11.204727 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:11.205385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:11.206212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:11.206483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:11.208136 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:11.279271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:11.317049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:11.318480 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40f027-7df8-45ca-a2b5-e462c9602221 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:11.336319 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 665/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:13.406216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:13.406742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:13.406742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:13.408116 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 659/1324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:13.413247 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcdc7-4fc5-4257-95d2-94a5b981dc09 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:13.413633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcdc7-4fc5-4257-95d2-94a5b981dc09 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:13.413797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbcdc7-4fc5-4257-95d2-94a5b981dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:13.477729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-cffbcdc7-4fc5-4257-95d2-94a5b981dc09 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:13.478917 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-cffbcdc7-4fc5-4257-95d2-94a5b981dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:13.576207 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 666/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:13.612356 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:13.613906 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:13.718731 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9138-8326-4155-82ed-7480b244e9a3 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:13.792047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:13.792637 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:13.792923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:13.793201 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:13.794815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:13.811211 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:13.908012 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:13.909545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a339183-7451-4d4d-bf7d-f26087a55382 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:13.927493 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 660/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:15.995116 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:15.995683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:15.995683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:15.997109 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 667/1327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:16.003252 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111b718-7fd2-4b61-907a-0555261b3ed5 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:16.003794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111b718-7fd2-4b61-907a-0555261b3ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:16.003794 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111b718-7fd2-4b61-907a-0555261b3ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:16.075661 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-5111b718-7fd2-4b61-907a-0555261b3ed5 None None] MFA Rules not processed for user `d6a901d47b174c20bc27a77db56745a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:16.076882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-5111b718-7fd2-4b61-907a-0555261b3ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:16.142029 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:16.173950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 661/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:16.211749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:16.213491 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:16.246332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:16.322176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281e9e-cdc3-4a7c-90f7-5aa9625264d9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:16.394413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:16.395060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:16.395342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:16.395611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:16.397248 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:16.477040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:16.508826 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:16.510879 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8634d5c-06ac-4fc3-8eb9-797487474ba4 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:16.529552 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 668/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:19.002601 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:19.003180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:19.003180 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:19.004536 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 662/1330] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:19.009721 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd60fa3-6c8e-4328-8be0-780f173e16eb None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:19.010106 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd60fa3-6c8e-4328-8be0-780f173e16eb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:19.010269 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd60fa3-6c8e-4328-8be0-780f173e16eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:19.072263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-8bd60fa3-6c8e-4328-8be0-780f173e16eb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:19.073481 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-8bd60fa3-6c8e-4328-8be0-780f173e16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:19.166303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 669/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:19.201689 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:19.203193 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:19.303129 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee47e70-bd6f-4d52-bace-eda5b831f1c4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:19.372643 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:19.373282 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:19.373563 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:19.373836 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:19.375677 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:19.402145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:19.483068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:19.484545 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73cd01-8281-43d8-96fe-3257f193fdbd service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:19.503900 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 663/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:21.590823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:21.591342 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:21.591436 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:21.592816 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 670/1333] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:21.597957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e723-f7da-4eed-86b6-d95f57600e79 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:21.598358 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e723-f7da-4eed-86b6-d95f57600e79 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:21.598503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7e723-f7da-4eed-86b6-d95f57600e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:21.661152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-92c7e723-f7da-4eed-86b6-d95f57600e79 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:21.662354 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-92c7e723-f7da-4eed-86b6-d95f57600e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:21.734884 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:21.757254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 664/1334] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:34:21.796345 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:21.797944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:21.837703 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:21.901165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cec14b-3d29-4cab-a8bc-9690bae9f78f None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:21.973667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:21.974311 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:21.974596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:21.974873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:21.976533 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:22.058329 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:22.083606 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:22.085082 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072783-be47-45e7-b018-588debd80f09 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:22.104452 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 671/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:24.739242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32370-9a92-4463-bf0c-2b6ee06c5f8c None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:24.739750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32370-9a92-4463-bf0c-2b6ee06c5f8c None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:24.739750 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e32370-9a92-4463-bf0c-2b6ee06c5f8c None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:24.741271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 665/1336] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:24.746453 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051a47-463f-43ca-8c4b-f6942b5c5b0b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:24.746933 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051a47-463f-43ca-8c4b-f6942b5c5b0b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:24.747038 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051a47-463f-43ca-8c4b-f6942b5c5b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:24.810191 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-ad051a47-463f-43ca-8c4b-f6942b5c5b0b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:24.811385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-ad051a47-463f-43ca-8c4b-f6942b5c5b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:24.906020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 672/1337] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:24.957593 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:24.957976 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:24.958261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:24.959625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 666/1338] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 22:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:24.965464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973615b6-f57e-4d06-8ce7-c6b52664cf98 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:24.965756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973615b6-f57e-4d06-8ce7-c6b52664cf98 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:24.966033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973615b6-f57e-4d06-8ce7-c6b52664cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:25.019195 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:25.040837 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-973615b6-f57e-4d06-8ce7-c6b52664cf98 None None] MFA Rules not processed for user `79e38a947d4a42f68cb6457ae2101234`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:25.042029 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-973615b6-f57e-4d06-8ce7-c6b52664cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:25.114712 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 673/1339] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 22:34:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:25.123733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:25.125520 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:25.228025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e96bd-5df9-485c-a4e0-2b1646070264 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:25.299918 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:25.300525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:25.300812 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:25.301089 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:25.302710 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:25.337909 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:25.409790 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:25.411230 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd34ee-4bac-4981-b231-2a7df47b6d02 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:25.430277 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 667/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 22:34:30.195525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:30.196047 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:30.196385 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:30.197741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 674/1341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:30.202926 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbad2-95be-4231-ac10-1c272e6aad0e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:30.203374 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbad2-95be-4231-ac10-1c272e6aad0e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:30.203482 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bbad2-95be-4231-ac10-1c272e6aad0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:30.280734 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-a90bbad2-95be-4231-ac10-1c272e6aad0e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:30.281940 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-a90bbad2-95be-4231-ac10-1c272e6aad0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:30.374439 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:30.387437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 668/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:30.427397 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:30.429603 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:30.523998 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dcedd-5fb3-4e74-b5d4-fa0497ff2a3b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:30.527465 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:30.528111 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:30.528394 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:30.528700 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:30.538280 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:30.539749 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3effd73-4962-4eec-88d1-552f13863850 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:30.549674 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 675/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:33.593421 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8697-f79b-4bd3-9aad-815e0ab1e240 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:33.594027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8697-f79b-4bd3-9aad-815e0ab1e240 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:33.594027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed8697-f79b-4bd3-9aad-815e0ab1e240 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:33.595981 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 669/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:33.602025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a74-b116-4640-b9ea-a555aa316047 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:33.602620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a74-b116-4640-b9ea-a555aa316047 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:33.602620 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7228a74-b116-4640-b9ea-a555aa316047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:33.630865 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-f7228a74-b116-4640-b9ea-a555aa316047 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:33.632196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-f7228a74-b116-4640-b9ea-a555aa316047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:33.659950 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:33.710417 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 676/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:33.747912 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed8697-f79b-4bd3-9aad-815e0ab1e240 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:33.758719 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed8697-f79b-4bd3-9aad-815e0ab1e240 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:33.762239 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:33.762871 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:33.763158 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:33.763438 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:33.772802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:33.774221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6821157-8c72-4122-88b7-709182534402 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:33.784445 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 670/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:38.287217 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c420ec2-2f6a-4b6a-ac07-ef8a3ae9712b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:38.287745 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c420ec2-2f6a-4b6a-ac07-ef8a3ae9712b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:38.287860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c420ec2-2f6a-4b6a-ac07-ef8a3ae9712b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:38.289485 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 677/1347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:38.295025 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1576d3-373e-4b94-898f-9691fa65a7c0 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:38.295417 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1576d3-373e-4b94-898f-9691fa65a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:38.295624 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1576d3-373e-4b94-898f-9691fa65a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:38.313431 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ea1576d3-373e-4b94-898f-9691fa65a7c0 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:38.314673 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ea1576d3-373e-4b94-898f-9691fa65a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:38.322699 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 671/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:38.361151 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c420ec2-2f6a-4b6a-ac07-ef8a3ae9712b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:38.372125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c420ec2-2f6a-4b6a-ac07-ef8a3ae9712b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:38.382445 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:38.383102 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:38.383391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:38.383667 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:38.394075 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:38.395571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cdfb7-6378-46fe-a039-552e4043ec5d service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:38.405875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 678/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:43.416881 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ed6a-f8f0-4384-a208-e07d33809e8b None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:43.417372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ed6a-f8f0-4384-a208-e07d33809e8b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:43.417372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5ed6a-f8f0-4384-a208-e07d33809e8b None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:43.418929 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 672/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:34:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:43.439549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffeec4-bdd2-4e94-a781-ab590295ddd4 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:43.440076 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffeec4-bdd2-4e94-a781-ab590295ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:43.440182 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffeec4-bdd2-4e94-a781-ab590295ddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:43.520469 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-cfffeec4-bdd2-4e94-a781-ab590295ddd4 None None] MFA Rules not processed for user `ef99546296c94b1886157c43f82fc315`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:43.521814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-cfffeec4-bdd2-4e94-a781-ab590295ddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:43.597334 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 679/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:34:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:47.718271 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0455-7246-4eed-8e3f-cc46d595c596 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:47.719267 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0455-7246-4eed-8e3f-cc46d595c596 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:47.720253 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae0455-7246-4eed-8e3f-cc46d595c596 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:47.721796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 673/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:34:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:47.726944 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1071ba4-2915-49aa-bf07-44f70915e38d None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:47.727354 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1071ba4-2915-49aa-bf07-44f70915e38d None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:47.727732 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1071ba4-2915-49aa-bf07-44f70915e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:47.747476 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-c1071ba4-2915-49aa-bf07-44f70915e38d None None] MFA Rules not processed for user `ef99546296c94b1886157c43f82fc315`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:47.748975 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-c1071ba4-2915-49aa-bf07-44f70915e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:47.758048 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 680/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:34:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:48.308815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=13 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:49.245101 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5c4-938a-4093-a076-fed2f1678681 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:49.245771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5c4-938a-4093-a076-fed2f1678681 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:49.245771 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d5c4-938a-4093-a076-fed2f1678681 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:49.247391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 674/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:34:49.252962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936294-2ddb-44ed-85c4-4cbf974ac530 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:49.253420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936294-2ddb-44ed-85c4-4cbf974ac530 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:49.253535 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e936294-2ddb-44ed-85c4-4cbf974ac530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:49.271486 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-8e936294-2ddb-44ed-85c4-4cbf974ac530 None None] MFA Rules not processed for user `ef99546296c94b1886157c43f82fc315`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:49.272747 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-8e936294-2ddb-44ed-85c4-4cbf974ac530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:49.281170 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 681/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:34:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:52.763525 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0404ec-1ec9-4eac-a4e0-6252151d7fd9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:52.764029 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0404ec-1ec9-4eac-a4e0-6252151d7fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:52.764029 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0404ec-1ec9-4eac-a4e0-6252151d7fd9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:52.768302 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 675/1356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:52.771171 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578f04-7290-4781-b233-48516f6d0ab8 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:52.771611 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578f04-7290-4781-b233-48516f6d0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:52.771705 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50578f04-7290-4781-b233-48516f6d0ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:52.791798 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-50578f04-7290-4781-b233-48516f6d0ab8 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:52.793266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-50578f04-7290-4781-b233-48516f6d0ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:52.802562 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 682/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:52.856903 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750122bf-94b0-4b23-a07c-88e83ee5b5df None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:52.857300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750122bf-94b0-4b23-a07c-88e83ee5b5df None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:52.857825 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750122bf-94b0-4b23-a07c-88e83ee5b5df None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:52.861168 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 676/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 22:34:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:52.866756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbcf38-d9e3-480e-9994-1877de307d38 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:52.867233 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbcf38-d9e3-480e-9994-1877de307d38 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:52.867675 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbcf38-d9e3-480e-9994-1877de307d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:52.911590 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:34:52.918895 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-91dbcf38-d9e3-480e-9994-1877de307d38 None None] MFA Rules not processed for user `d620bd7c93f640ef8ec03ea691926996`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:52.920246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-91dbcf38-d9e3-480e-9994-1877de307d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:53.001120 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 683/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 22:34:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:34:53.009617 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750122bf-94b0-4b23-a07c-88e83ee5b5df None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:53.024679 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750122bf-94b0-4b23-a07c-88e83ee5b5df None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:53.030336 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:53.031305 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:53.031760 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:53.033032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:53.043883 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:53.045626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafddda0-e4d5-405f-9ff7-6330c7390839 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:53.056363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 677/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 22:34:55.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8a5-53b4-4f4c-9674-1ac1576013fd None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:55.296275 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8a5-53b4-4f4c-9674-1ac1576013fd None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:55.296372 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2f8a5-53b4-4f4c-9674-1ac1576013fd None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:55.300777 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 684/1361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:55.302991 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d90fb-9704-43da-b806-16e0ec522264 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:55.303402 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d90fb-9704-43da-b806-16e0ec522264 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:55.303547 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d90fb-9704-43da-b806-16e0ec522264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:55.321658 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d99d90fb-9704-43da-b806-16e0ec522264 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:55.322847 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d99d90fb-9704-43da-b806-16e0ec522264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:55.331348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 678/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:55.373751 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f8a5-53b4-4f4c-9674-1ac1576013fd None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:55.389345 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2f8a5-53b4-4f4c-9674-1ac1576013fd None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:55.395487 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:55.396221 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:55.396596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:55.396989 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:55.406255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:55.408147 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c6bfb-42f7-4bab-a349-e96fa01813b8 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:55.418616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 685/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:34:57.902152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292c277-d4c9-4947-b9d2-2307fa1e500a None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:57.902670 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292c277-d4c9-4947-b9d2-2307fa1e500a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:57.902789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292c277-d4c9-4947-b9d2-2307fa1e500a None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:57.904064 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 679/1364] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:34:57.910231 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21eff-f590-4fcf-87b6-095f7f1afa5c None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:57.911178 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21eff-f590-4fcf-87b6-095f7f1afa5c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:57.911463 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea21eff-f590-4fcf-87b6-095f7f1afa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:57.930503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-eea21eff-f590-4fcf-87b6-095f7f1afa5c None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:57.931853 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-eea21eff-f590-4fcf-87b6-095f7f1afa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:57.940125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 686/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:57.987393 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c3cb4-ffd6-4b35-a31b-17fdd41c4372 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:57.987773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c3cb4-ffd6-4b35-a31b-17fdd41c4372 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:57.988143 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c3cb4-ffd6-4b35-a31b-17fdd41c4372 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:57.989614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 680/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 22:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:34:57.995049 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40866d2-71d7-41c9-a7ab-55ea539dc75e None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:57.995337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40866d2-71d7-41c9-a7ab-55ea539dc75e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:57.995822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40866d2-71d7-41c9-a7ab-55ea539dc75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:58.013797 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-a40866d2-71d7-41c9-a7ab-55ea539dc75e None None] MFA Rules not processed for user `d620bd7c93f640ef8ec03ea691926996`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:34:58.014951 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-a40866d2-71d7-41c9-a7ab-55ea539dc75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:34:58.024420 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 687/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 22:34:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:34:58.031824 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c3cb4-ffd6-4b35-a31b-17fdd41c4372 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:34:58.046486 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c3cb4-ffd6-4b35-a31b-17fdd41c4372 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:34:58.051769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:34:58.052391 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:34:58.052728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:34:58.052993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:34:58.060957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:34:58.062526 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e44cf9-0dd9-46f1-9b2f-bcde2158193c service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:34:58.071976 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 681/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:00.312161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e905-bb9d-485b-a084-83d5593c4ef0 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:00.312765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e905-bb9d-485b-a084-83d5593c4ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:00.312765 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e905-bb9d-485b-a084-83d5593c4ef0 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:00.314947 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 688/1369] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:00.320081 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc804-6320-4926-8ebe-02b8ff6103e9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:00.320519 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc804-6320-4926-8ebe-02b8ff6103e9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:00.320688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc804-6320-4926-8ebe-02b8ff6103e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:00.339008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-1fffc804-6320-4926-8ebe-02b8ff6103e9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:00.340320 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-1fffc804-6320-4926-8ebe-02b8ff6103e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:00.349348 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 682/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:00.393223 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e905-bb9d-485b-a084-83d5593c4ef0 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:00.408619 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e905-bb9d-485b-a084-83d5593c4ef0 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:00.414025 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:00.414692 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:00.414976 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:00.415256 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:00.424496 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:00.426139 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a658466-6ca8-450f-b09a-150534ef3491 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:00.435995 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 689/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:00.918702 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa5a49-4287-4b37-bd1d-98d4b481d5b7 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:00.918992 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa5a49-4287-4b37-bd1d-98d4b481d5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:00.919476 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa5a49-4287-4b37-bd1d-98d4b481d5b7 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:00.921038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 683/1372] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:00.926616 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dc614-b42b-4698-a436-a816e848f035 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:00.926935 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dc614-b42b-4698-a436-a816e848f035 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:00.927221 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dc614-b42b-4698-a436-a816e848f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:00.946710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-dd1dc614-b42b-4698-a436-a816e848f035 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:00.947904 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-dd1dc614-b42b-4698-a436-a816e848f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:00.956470 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 690/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:01.311733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7c65-7df3-4f0e-8320-da57e7c1b515 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:01.312022 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7c65-7df3-4f0e-8320-da57e7c1b515 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:01.312300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d7c65-7df3-4f0e-8320-da57e7c1b515 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:01.314365 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 684/1374] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jun 29 22:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:01.319276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83fee-956b-4ae7-8016-cec4d5dd1611 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:01.319835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83fee-956b-4ae7-8016-cec4d5dd1611 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:01.319835 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec83fee-956b-4ae7-8016-cec4d5dd1611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:01.369026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-fec83fee-956b-4ae7-8016-cec4d5dd1611 None None] MFA Rules not processed for user `ec4e612bcb464df28bcf900197a64449`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:01.370237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-fec83fee-956b-4ae7-8016-cec4d5dd1611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:01.432447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 691/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jun 29 22:35:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:01.440458 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7c65-7df3-4f0e-8320-da57e7c1b515 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:01.451325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d7c65-7df3-4f0e-8320-da57e7c1b515 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:01.455499 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec4e612bcb464df28bcf900197a64449', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:01.456198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:01.456586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:01.456923 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:01.466137 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:01.467664 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818aeb98-6b0b-4856-b990-9832803a47b4 service cinder] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:01.477455 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 685/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:02.641348 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe89-ccb1-4825-a4eb-a5608a21502e None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:02.641986 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe89-ccb1-4825-a4eb-a5608a21502e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:02.641986 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fbe89-ccb1-4825-a4eb-a5608a21502e None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:02.643258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 692/1377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:02.648375 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3580e-8f5c-44ce-b1b7-a6acaa19483d None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:02.648821 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3580e-8f5c-44ce-b1b7-a6acaa19483d None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:02.648959 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3580e-8f5c-44ce-b1b7-a6acaa19483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:02.666749 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e2c3580e-8f5c-44ce-b1b7-a6acaa19483d None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:02.667927 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e2c3580e-8f5c-44ce-b1b7-a6acaa19483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:02.676293 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 686/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:02.718927 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fbe89-ccb1-4825-a4eb-a5608a21502e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:02.733366 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fbe89-ccb1-4825-a4eb-a5608a21502e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:02.739188 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:02.739810 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:02.740091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:02.740365 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:02.748447 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:02.750023 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ca247-f612-4856-bf39-80a791190779 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:02.754160 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:35:02.760218 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 693/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:04.943176 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298f23-543f-4df4-af3f-842a12a8b2db None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:04.943715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298f23-543f-4df4-af3f-842a12a8b2db None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:04.943715 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298f23-543f-4df4-af3f-842a12a8b2db None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:04.945103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 687/1380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:04.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaf6b-0bf4-4b98-b76d-ad75c4c38b6a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:04.951045 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaf6b-0bf4-4b98-b76d-ad75c4c38b6a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:04.951164 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eeaf6b-0bf4-4b98-b76d-ad75c4c38b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:04.970142 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-a1eeaf6b-0bf4-4b98-b76d-ad75c4c38b6a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:04.971331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-a1eeaf6b-0bf4-4b98-b76d-ad75c4c38b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:04.979314 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 694/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:05.027008 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298f23-543f-4df4-af3f-842a12a8b2db None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:05.056733 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298f23-543f-4df4-af3f-842a12a8b2db None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:05.062351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:05.063532 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:05.063814 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:05.064085 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:05.072441 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:05.074020 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766d7f3-80db-4ca1-af2f-eeb739d04efa service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:05.092080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 688/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:07.309558 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ee4f-26ec-43e1-80f5-08b147de3ad3 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:07.310091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ee4f-26ec-43e1-80f5-08b147de3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:07.310091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36ee4f-26ec-43e1-80f5-08b147de3ad3 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:07.311458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 695/1383] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:35:07.316579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4276c-5672-457b-a695-bc815844a829 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:07.317000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4276c-5672-457b-a695-bc815844a829 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:07.317115 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4276c-5672-457b-a695-bc815844a829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:07.334614 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-8bc4276c-5672-457b-a695-bc815844a829 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:07.335777 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-8bc4276c-5672-457b-a695-bc815844a829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:07.343579 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 689/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:07.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ee4f-26ec-43e1-80f5-08b147de3ad3 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:07.401601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36ee4f-26ec-43e1-80f5-08b147de3ad3 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:07.407563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:07.408238 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:07.408566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:07.408836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:07.417112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:07.418710 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e19b7e-7cb8-4547-a226-e48c68c11942 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:07.429392 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 696/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:09.494508 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cf2f-d92d-493f-8013-3b88db0d37ba None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:09.495125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cf2f-d92d-493f-8013-3b88db0d37ba None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:09.495125 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5cf2f-d92d-493f-8013-3b88db0d37ba None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:09.496379 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 690/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:09.502547 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dabc7-7f69-48d7-8da9-86f55fcc391a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:09.502965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dabc7-7f69-48d7-8da9-86f55fcc391a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:09.503128 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dabc7-7f69-48d7-8da9-86f55fcc391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:09.522379 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-e65dabc7-7f69-48d7-8da9-86f55fcc391a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:09.523571 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-e65dabc7-7f69-48d7-8da9-86f55fcc391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:09.531354 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 697/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:09.575848 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5cf2f-d92d-493f-8013-3b88db0d37ba None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:09.597886 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5cf2f-d92d-493f-8013-3b88db0d37ba None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:09.605897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:09.606889 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:09.607280 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:09.607682 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:09.621145 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:09.623798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315e15-7e29-4c0e-9974-86470c72d75b service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:09.636460 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 691/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:11.935836 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9668-1ba3-4394-b410-77542d54003a None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:11.936671 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9668-1ba3-4394-b410-77542d54003a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:11.936671 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9668-1ba3-4394-b410-77542d54003a None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:11.937874 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 698/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:11.944091 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cec60-f837-429e-9570-ef9d5351332e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:11.944725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cec60-f837-429e-9570-ef9d5351332e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:11.944725 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cec60-f837-429e-9570-ef9d5351332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:11.963240 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7d2cec60-f837-429e-9570-ef9d5351332e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:11.964487 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7d2cec60-f837-429e-9570-ef9d5351332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:11.972615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 692/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:12.024305 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be9668-1ba3-4394-b410-77542d54003a None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:12.040648 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be9668-1ba3-4394-b410-77542d54003a None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:12.047622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:12.049105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:12.049458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:12.049812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:12.060713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:12.062824 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c360e0-6bad-4b6e-a657-880a81f750f7 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:12.080168 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 699/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:15.376529 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3d0f-083e-40dd-8c04-7cf1a39ae526 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:15.377067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3d0f-083e-40dd-8c04-7cf1a39ae526 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:15.377067 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3d0f-083e-40dd-8c04-7cf1a39ae526 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:15.378481 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 693/1392] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:15.383878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545a2e-d986-4f18-b1f7-c31e57ccd82a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:15.384323 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545a2e-d986-4f18-b1f7-c31e57ccd82a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:15.384456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a545a2e-d986-4f18-b1f7-c31e57ccd82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:15.402337 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7a545a2e-d986-4f18-b1f7-c31e57ccd82a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:15.403549 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7a545a2e-d986-4f18-b1f7-c31e57ccd82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:15.411411 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 700/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:15.454745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da3d0f-083e-40dd-8c04-7cf1a39ae526 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:15.468757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da3d0f-083e-40dd-8c04-7cf1a39ae526 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:15.474159 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:15.474789 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:15.475068 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:15.475339 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:15.483683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:15.485290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e20312-b929-427f-b71f-6c835c2f66dc service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:15.494868 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 694/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:16.834481 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8113-ea74-46df-ab86-b72ad5690655 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:16.835018 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8113-ea74-46df-ab86-b72ad5690655 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:16.835112 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa8113-ea74-46df-ab86-b72ad5690655 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:16.836622 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 701/1395] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:16.841777 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1b29-55c1-4dc1-9170-b56baf7104d9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:16.842219 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1b29-55c1-4dc1-9170-b56baf7104d9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:16.842412 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe1b29-55c1-4dc1-9170-b56baf7104d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:16.859775 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-9bbe1b29-55c1-4dc1-9170-b56baf7104d9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:16.860986 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-9bbe1b29-55c1-4dc1-9170-b56baf7104d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:16.869040 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 695/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:16.923637 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60dcd-5d32-404e-a4a6-0045338be28b None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:16.923930 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60dcd-5d32-404e-a4a6-0045338be28b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:16.924212 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b60dcd-5d32-404e-a4a6-0045338be28b None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:16.925607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 702/1397] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jun 29 22:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:16.930494 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb0d2-ba3d-4d2f-ad29-689b662f3326 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:16.930786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb0d2-ba3d-4d2f-ad29-689b662f3326 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:16.931103 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb0d2-ba3d-4d2f-ad29-689b662f3326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:16.980649 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4f0eb0d2-ba3d-4d2f-ad29-689b662f3326 None None] MFA Rules not processed for user `65b5d79ac93d475ab781370bd3ca4877`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:16.981831 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4f0eb0d2-ba3d-4d2f-ad29-689b662f3326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:17.039972 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 696/1398] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jun 29 22:35:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:17.047396 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60dcd-5d32-404e-a4a6-0045338be28b None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:17.058137 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b60dcd-5d32-404e-a4a6-0045338be28b None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:17.061661 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b5d79ac93d475ab781370bd3ca4877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:17.062287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:17.062570 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:17.062846 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:17.072942 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:17.074490 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208393-b8df-4b03-ad19-dd2fa9e430a7 service glance] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:17.084949 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 703/1399] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:17.683527 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906bcb-b710-4882-a8a3-471790e08222 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:17.683816 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906bcb-b710-4882-a8a3-471790e08222 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:17.684098 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb906bcb-b710-4882-a8a3-471790e08222 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:17.686844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 697/1400] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:17.691173 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749a5-4dcb-404f-8e67-33806aaddb5b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:17.691464 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749a5-4dcb-404f-8e67-33806aaddb5b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:17.691741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200749a5-4dcb-404f-8e67-33806aaddb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:17.708964 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-200749a5-4dcb-404f-8e67-33806aaddb5b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:17.710149 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-200749a5-4dcb-404f-8e67-33806aaddb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:17.717892 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 704/1401] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:17.763840 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb906bcb-b710-4882-a8a3-471790e08222 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:17.778876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb906bcb-b710-4882-a8a3-471790e08222 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:17.785126 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:17.785796 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:17.786079 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:17.786352 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:17.795583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:17.797300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bad9990-8731-4e2b-a0f3-f3d972e16a3f service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:17.808666 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 698/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:17.969310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc6bf-5f23-4b6d-af2e-cb5d5b56dd2e None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:17.970358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc6bf-5f23-4b6d-af2e-cb5d5b56dd2e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:17.970521 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bc6bf-5f23-4b6d-af2e-cb5d5b56dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:18.023141 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6e4bc6bf-5f23-4b6d-af2e-cb5d5b56dd2e None None] MFA Rules not processed for user `b55e15e1ac0f4edc972a89f07c7bea18`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:18.024292 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6e4bc6bf-5f23-4b6d-af2e-cb5d5b56dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:18.093946 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 705/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Wed Jun 29 22:35:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:18.142467 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cce40-d8fa-48bb-856a-6a2c623a9db9 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:18.143016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cce40-d8fa-48bb-856a-6a2c623a9db9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:18.143016 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cce40-d8fa-48bb-856a-6a2c623a9db9 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:18.144390 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 699/1404] 10.222.0.16 () {54 vars in 942 bytes} [Wed Jun 29 22:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:18.151511 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84c1-ed31-40e6-997e-64791da0b2c7 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:18.151806 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84c1-ed31-40e6-997e-64791da0b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:18.152088 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c84c1-ed31-40e6-997e-64791da0b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:18.202258 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-4c2c84c1-ed31-40e6-997e-64791da0b2c7 None None] MFA Rules not processed for user `5a6b2fb527f041f7ba3c2447b824141c`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:18.203483 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-4c2c84c1-ed31-40e6-997e-64791da0b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:18.237828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=100 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:35:18.275980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 706/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Wed Jun 29 22:35:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:18.286248 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cce40-d8fa-48bb-856a-6a2c623a9db9 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:18.295000 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=100 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:35:18.300021 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cce40-d8fa-48bb-856a-6a2c623a9db9 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:18.305104 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a6b2fb527f041f7ba3c2447b824141c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:18.305745 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:18.306031 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:18.318657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:18.318657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:18.318657 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ef553-076f-41fb-a83a-1a425719e4d3 service swift] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:18.324980 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 700/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Wed Jun 29 22:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 22:35:19.982251 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791e0f-fbd7-47ca-adf3-85ffa2baecc8 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:19.982877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791e0f-fbd7-47ca-adf3-85ffa2baecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:19.982877 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef791e0f-fbd7-47ca-adf3-85ffa2baecc8 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:19.984601 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 707/1407] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:19.989811 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941818a-e1f4-4ef6-b3ea-21d9f8167ede None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:19.990208 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941818a-e1f4-4ef6-b3ea-21d9f8167ede None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:19.990417 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941818a-e1f4-4ef6-b3ea-21d9f8167ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:20.014387 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4941818a-e1f4-4ef6-b3ea-21d9f8167ede None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:20.015602 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4941818a-e1f4-4ef6-b3ea-21d9f8167ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:20.024472 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 701/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:20.069332 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef791e0f-fbd7-47ca-adf3-85ffa2baecc8 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:20.084265 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef791e0f-fbd7-47ca-adf3-85ffa2baecc8 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:20.092698 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:20.093344 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:20.093629 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:20.093908 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:20.102827 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:20.104510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b06713-4fe1-449e-b314-018c3f23b775 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:20.113830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 708/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:30.004221 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=7 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:35:30.109636 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=21 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:35:41.825167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381907f-57f4-4cee-8096-fc8101e486ca None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:41.825718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381907f-57f4-4cee-8096-fc8101e486ca None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:41.825718 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381907f-57f4-4cee-8096-fc8101e486ca None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:41.827072 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 702/1410] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jun 29 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:41.832165 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843bce-2be6-4afe-ab77-8f508a4ef7be None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:41.832609 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843bce-2be6-4afe-ab77-8f508a4ef7be None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:41.832756 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65843bce-2be6-4afe-ab77-8f508a4ef7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:41.850709 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-65843bce-2be6-4afe-ab77-8f508a4ef7be None None] MFA Rules not processed for user `ef99546296c94b1886157c43f82fc315`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:41.851882 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-65843bce-2be6-4afe-ab77-8f508a4ef7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:41.860125 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 709/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jun 29 22:35:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:41.874444 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1518-23c7-418c-9282-14d443a40d84 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:41.874731 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1518-23c7-418c-9282-14d443a40d84 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:41.875009 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d1518-23c7-418c-9282-14d443a40d84 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:41.876882 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 703/1412] 10.222.0.16 () {54 vars in 918 bytes} [Wed Jun 29 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:41.881328 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601afb-7970-4116-82a1-23239097724c None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:41.881614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601afb-7970-4116-82a1-23239097724c None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:41.881887 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601afb-7970-4116-82a1-23239097724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:41.899554 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-d4601afb-7970-4116-82a1-23239097724c None None] MFA Rules not processed for user `d620bd7c93f640ef8ec03ea691926996`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:41.900741 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-d4601afb-7970-4116-82a1-23239097724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:41.910225 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 710/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Wed Jun 29 22:35:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:44.492962 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf667b-2b25-4b01-90d7-a2a5e0de2788 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:44.493502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf667b-2b25-4b01-90d7-a2a5e0de2788 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:44.493502 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf667b-2b25-4b01-90d7-a2a5e0de2788 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:44.494793 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:44.499980 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953cc3a-9261-458d-a283-9d314a2315fb None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:44.500458 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953cc3a-9261-458d-a283-9d314a2315fb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:44.500597 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953cc3a-9261-458d-a283-9d314a2315fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:44.518873 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-1953cc3a-9261-458d-a283-9d314a2315fb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:44.520064 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-1953cc3a-9261-458d-a283-9d314a2315fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:44.527766 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:44.570724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf667b-2b25-4b01-90d7-a2a5e0de2788 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:44.584937 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf667b-2b25-4b01-90d7-a2a5e0de2788 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:44.590172 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:44.590798 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:44.591080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:44.591355 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:44.599694 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:44.601289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9196d3-ccd2-4938-83bc-22857ccb4b19 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:44.610351 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 705/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:45.519201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8ae-4e19-4bb6-bc29-c37e392cba11 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:45.519806 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8ae-4e19-4bb6-bc29-c37e392cba11 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:45.519806 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2c8ae-4e19-4bb6-bc29-c37e392cba11 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:45.521067 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:45.525829 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce0fb-0274-40ea-94b2-be2ccccc5e91 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:45.526223 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce0fb-0274-40ea-94b2-be2ccccc5e91 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:45.526382 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce0fb-0274-40ea-94b2-be2ccccc5e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:45.543815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-af3ce0fb-0274-40ea-94b2-be2ccccc5e91 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:45.545078 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-af3ce0fb-0274-40ea-94b2-be2ccccc5e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:45.552742 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:45.701077 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8ae-4e19-4bb6-bc29-c37e392cba11 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:45.714939 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2c8ae-4e19-4bb6-bc29-c37e392cba11 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:45.720361 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:45.721005 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:45.721285 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:45.721555 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:45.729532 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:45.731100 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817f12b-748e-48e4-ba28-dda93de6ed1d service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:45.740959 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 713/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:46.626316 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98037-dee5-4964-931a-1664eb990671 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:46.626875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98037-dee5-4964-931a-1664eb990671 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:46.626875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e98037-dee5-4964-931a-1664eb990671 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:46.628208 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:46.633155 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7c7f-14b1-4370-ab68-9adb9708da80 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:46.633608 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7c7f-14b1-4370-ab68-9adb9708da80 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:46.633713 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab7c7f-14b1-4370-ab68-9adb9708da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:46.651689 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-56ab7c7f-14b1-4370-ab68-9adb9708da80 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:46.652912 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-56ab7c7f-14b1-4370-ab68-9adb9708da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:46.661222 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:46.810197 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98037-dee5-4964-931a-1664eb990671 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:46.824474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e98037-dee5-4964-931a-1664eb990671 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:46.830445 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:46.831070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:46.831350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:46.831628 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:46.839429 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:46.841030 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f6395-dc19-43a6-81eb-d53b33f98126 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:46.850583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 708/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:47.716563 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880836c-46f2-4129-a17f-8b49f98e5f60 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:47.717091 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880836c-46f2-4129-a17f-8b49f98e5f60 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:47.717187 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880836c-46f2-4129-a17f-8b49f98e5f60 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:47.718492 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:47.723457 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2c2-f787-4d3c-a0f9-4f0ed9970f7e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:47.723860 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2c2-f787-4d3c-a0f9-4f0ed9970f7e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:47.724035 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2c2-f787-4d3c-a0f9-4f0ed9970f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:47.741508 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-7d86e2c2-f787-4d3c-a0f9-4f0ed9970f7e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:47.742675 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-7d86e2c2-f787-4d3c-a0f9-4f0ed9970f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:47.750496 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:47.902857 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880836c-46f2-4129-a17f-8b49f98e5f60 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:47.916901 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880836c-46f2-4129-a17f-8b49f98e5f60 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:47.922185 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:47.922807 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:47.923581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:47.923855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:47.931812 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:47.933422 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6623e81-a75b-4f0e-858c-9caaa53e67cf service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:47.943271 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 716/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:48.789870 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b9dd-2120-46c8-91bb-385bcd875213 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:48.790409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b9dd-2120-46c8-91bb-385bcd875213 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:48.790409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47b9dd-2120-46c8-91bb-385bcd875213 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:48.791767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:48.796591 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8412-0cf5-46a9-9d29-c8cc8fa4a03e None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:48.797015 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8412-0cf5-46a9-9d29-c8cc8fa4a03e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:48.797150 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf8412-0cf5-46a9-9d29-c8cc8fa4a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:48.814777 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-8fdf8412-0cf5-46a9-9d29-c8cc8fa4a03e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:48.816003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-8fdf8412-0cf5-46a9-9d29-c8cc8fa4a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:48.823672 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:48.974242 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b9dd-2120-46c8-91bb-385bcd875213 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:48.988324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47b9dd-2120-46c8-91bb-385bcd875213 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:48.993728 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:48.994359 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:48.994645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:48.994925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:49.003261 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:49.004897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67984b7f-2fc5-4a15-8b8c-54f08ae0337e service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:49.014076 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 711/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:49.850726 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c00a-b57d-4e32-bc3e-b7816cabbfe7 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:49.851266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c00a-b57d-4e32-bc3e-b7816cabbfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:49.851266 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c00a-b57d-4e32-bc3e-b7816cabbfe7 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:49.852673 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:49.857504 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801a49-3b4c-4545-80f3-7a7694bc1d74 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:49.857942 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801a49-3b4c-4545-80f3-7a7694bc1d74 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:49.858050 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31801a49-3b4c-4545-80f3-7a7694bc1d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:49.875400 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-31801a49-3b4c-4545-80f3-7a7694bc1d74 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:49.877409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-31801a49-3b4c-4545-80f3-7a7694bc1d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:49.884978 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:50.035814 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c00a-b57d-4e32-bc3e-b7816cabbfe7 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:50.050729 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c00a-b57d-4e32-bc3e-b7816cabbfe7 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:50.055926 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:50.056574 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:50.056855 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:50.057129 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:50.064962 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:50.066525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83655526-ee1e-4176-bd2b-ad35f5bf3541 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:50.075559 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 719/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:50.969202 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476551-de31-4513-a7c6-204469637399 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:50.969806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476551-de31-4513-a7c6-204469637399 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:50.969806 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0476551-de31-4513-a7c6-204469637399 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:50.971245 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:50.976189 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f85f30-6062-4310-819b-d52c30a95da3 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:50.976614 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f85f30-6062-4310-819b-d52c30a95da3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:50.976811 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f85f30-6062-4310-819b-d52c30a95da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:50.994840 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-10f85f30-6062-4310-819b-d52c30a95da3 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:50.996020 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-10f85f30-6062-4310-819b-d52c30a95da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:51.004772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:51.153908 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0476551-de31-4513-a7c6-204469637399 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:51.167951 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0476551-de31-4513-a7c6-204469637399 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:51.173782 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:51.174409 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:51.174688 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:51.174958 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:51.182947 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:51.187503 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866c3b1-8747-4512-a5c0-78e87bb2acce service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:51.194627 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 714/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:52.056276 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f72-67bb-45a7-a91c-b6b530d6d039 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:52.056881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f72-67bb-45a7-a91c-b6b530d6d039 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:52.056881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d963f72-67bb-45a7-a91c-b6b530d6d039 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:52.058253 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:52.063134 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d083f2-d21d-46d1-85fc-4d5916c37d20 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:52.064102 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d083f2-d21d-46d1-85fc-4d5916c37d20 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:52.064200 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d083f2-d21d-46d1-85fc-4d5916c37d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:52.082335 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-84d083f2-d21d-46d1-85fc-4d5916c37d20 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:52.083518 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-84d083f2-d21d-46d1-85fc-4d5916c37d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:52.091233 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:52.242437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963f72-67bb-45a7-a91c-b6b530d6d039 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:52.257190 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d963f72-67bb-45a7-a91c-b6b530d6d039 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:52.262678 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:52.263303 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:52.263580 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:52.263860 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:52.272796 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:52.274510 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75907a9-0e0d-4fef-8762-ce2e3139e1af service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:52.286236 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 722/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:53.187852 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567aecb-23a1-4fcb-a15f-887f7352bf5e None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:53.188283 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567aecb-23a1-4fcb-a15f-887f7352bf5e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:53.189070 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567aecb-23a1-4fcb-a15f-887f7352bf5e None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:53.190371 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jun 29 22:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:53.195358 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e9f5-1228-46aa-aac0-6f353be1d0b2 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:53.195772 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e9f5-1228-46aa-aac0-6f353be1d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:53.195920 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165e9f5-1228-46aa-aac0-6f353be1d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:53.213573 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-7165e9f5-1228-46aa-aac0-6f353be1d0b2 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:53.214755 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-7165e9f5-1228-46aa-aac0-6f353be1d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:53.222473 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jun 29 22:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:35:53.370367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567aecb-23a1-4fcb-a15f-887f7352bf5e None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:53.385635 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567aecb-23a1-4fcb-a15f-887f7352bf5e None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:53.391167 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:53.392468 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:53.392753 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:53.393027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:53.401347 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:53.402925 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656080-d830-4d1a-8a58-bdf924f53ab9 service nova] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:53.413124 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 717/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:55.349324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf7d25-2d36-43aa-9fd7-6c2c007442b7 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:55.349885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf7d25-2d36-43aa-9fd7-6c2c007442b7 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:55.349885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf7d25-2d36-43aa-9fd7-6c2c007442b7 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:55.351287 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:35:55.356634 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad424b-3b15-4622-8b25-143d650a8e63 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:55.357027 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad424b-3b15-4622-8b25-143d650a8e63 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:55.357204 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad424b-3b15-4622-8b25-143d650a8e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:55.375184 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-23ad424b-3b15-4622-8b25-143d650a8e63 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:55.377138 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-23ad424b-3b15-4622-8b25-143d650a8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:55.384867 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:55.423576 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf7d25-2d36-43aa-9fd7-6c2c007442b7 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:55.434176 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf7d25-2d36-43aa-9fd7-6c2c007442b7 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:55.437743 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:55.438875 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:55.439160 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:55.439434 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:55.448201 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:55.449674 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04cf55-43fa-4b32-ac96-c1f54a6fa78b service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:55.459094 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 725/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:35:57.631770 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b71b-632a-446c-a348-68f7abc10d64 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:57.632328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b71b-632a-446c-a348-68f7abc10d64 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:57.632328 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6b71b-632a-446c-a348-68f7abc10d64 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:57.633710 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:35:57.638864 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a50cc-e064-4bcd-8d3f-647e17765d17 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:57.639288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a50cc-e064-4bcd-8d3f-647e17765d17 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:57.639400 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a50cc-e064-4bcd-8d3f-647e17765d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:57.657184 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-160a50cc-e064-4bcd-8d3f-647e17765d17 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:35:57.658391 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-160a50cc-e064-4bcd-8d3f-647e17765d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:35:57.666095 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:35:57.704786 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6b71b-632a-446c-a348-68f7abc10d64 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:35:57.715390 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6b71b-632a-446c-a348-68f7abc10d64 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:35:57.718856 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:35:57.719480 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:35:57.719763 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:35:57.720038 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:35:57.728757 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:35:57.730171 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ebdd3-eada-4b01-9218-4924531a729d service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:35:57.739861 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 720/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:00.112885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89709d-d867-4885-95fd-a2c326ad440e None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:00.113474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89709d-d867-4885-95fd-a2c326ad440e None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:00.113474 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89709d-d867-4885-95fd-a2c326ad440e None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:00.114822 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:00.119904 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fdf3-db79-4197-89f3-96f4b711b1c9 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:00.120331 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fdf3-db79-4197-89f3-96f4b711b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:00.120495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7fdf3-db79-4197-89f3-96f4b711b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:00.138609 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-c2c7fdf3-db79-4197-89f3-96f4b711b1c9 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:00.139797 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-c2c7fdf3-db79-4197-89f3-96f4b711b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:00.147683 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:00.186237 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89709d-d867-4885-95fd-a2c326ad440e None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:00.197390 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89709d-d867-4885-95fd-a2c326ad440e None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:00.200878 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:00.201536 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:00.201823 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:00.202098 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:00.211065 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:00.212514 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091ce73-7612-4be1-baa6-081766599b89 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:00.221670 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 728/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:02.367325 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959720-5f19-41f5-ac78-a6b2ef001ca2 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:02.367865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959720-5f19-41f5-ac78-a6b2ef001ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:02.367865 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f959720-5f19-41f5-ac78-a6b2ef001ca2 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:02.369290 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:02.374610 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26d-745e-4029-b3ee-49e6a8b56dfe None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:02.375022 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26d-745e-4029-b3ee-49e6a8b56dfe None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:02.375167 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26d-745e-4029-b3ee-49e6a8b56dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:02.393158 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-810ef26d-745e-4029-b3ee-49e6a8b56dfe None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:02.394324 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-810ef26d-745e-4029-b3ee-49e6a8b56dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:02.401883 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:36:02.440613 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959720-5f19-41f5-ac78-a6b2ef001ca2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:02.450802 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f959720-5f19-41f5-ac78-a6b2ef001ca2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:02.454254 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:02.454872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:02.455150 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:02.455422 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:02.463993 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:02.465437 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c23bf7-8d6c-4b30-aa2c-919d33e3cf21 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:02.474895 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 723/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:04.540992 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89386f0-3fdd-405b-8c08-58d8daf074fb None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:04.541525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89386f0-3fdd-405b-8c08-58d8daf074fb None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:04.541525 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89386f0-3fdd-405b-8c08-58d8daf074fb None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:04.542861 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:04.548607 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e227a-53f1-4234-ba03-08473f185f5a None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:04.549034 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e227a-53f1-4234-ba03-08473f185f5a None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:04.549152 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e227a-53f1-4234-ba03-08473f185f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:04.567057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-4f1e227a-53f1-4234-ba03-08473f185f5a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:04.568272 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-4f1e227a-53f1-4234-ba03-08473f185f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:04.575957 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:04.613471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89386f0-3fdd-405b-8c08-58d8daf074fb None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:04.623897 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89386f0-3fdd-405b-8c08-58d8daf074fb None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:04.628263 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:04.628913 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:04.629196 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:04.629471 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:04.638246 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:04.639679 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574443f-2105-4be2-93c6-d207da346bda service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:04.649477 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 731/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:06.752552 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06129-253d-402f-8c73-a52c05220645 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:06.753121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06129-253d-402f-8c73-a52c05220645 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:06.753121 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06129-253d-402f-8c73-a52c05220645 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:06.754490 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:06.759653 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc168-e65e-4542-96bf-0b34c804da14 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:06.760032 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc168-e65e-4542-96bf-0b34c804da14 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:06.760206 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241bc168-e65e-4542-96bf-0b34c804da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:06.777395 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-241bc168-e65e-4542-96bf-0b34c804da14 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:06.778581 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-241bc168-e65e-4542-96bf-0b34c804da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:06.786161 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:06.823936 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f06129-253d-402f-8c73-a52c05220645 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:06.834586 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f06129-253d-402f-8c73-a52c05220645 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:06.838090 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:06.838726 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:06.839013 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:06.839292 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:06.848247 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:06.849713 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5eb4b7-c8aa-4489-ace3-6b47f7d47f6e service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:06.858973 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 726/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:08.928934 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154fc8-08e7-4a9e-b87c-ac87b4deb7c3 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:08.929505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154fc8-08e7-4a9e-b87c-ac87b4deb7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:08.929505 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154fc8-08e7-4a9e-b87c-ac87b4deb7c3 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:08.930866 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:08.936214 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eee61-5595-49d1-a6f1-976b91c764cb None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:08.936751 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eee61-5595-49d1-a6f1-976b91c764cb None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:08.936872 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225eee61-5595-49d1-a6f1-976b91c764cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:08.955064 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-225eee61-5595-49d1-a6f1-976b91c764cb None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:08.956226 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-225eee61-5595-49d1-a6f1-976b91c764cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:08.964047 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:09.002223 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154fc8-08e7-4a9e-b87c-ac87b4deb7c3 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:09.012830 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154fc8-08e7-4a9e-b87c-ac87b4deb7c3 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:09.016359 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:09.017026 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:09.017310 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:09.017586 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:09.026216 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:09.027633 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0790808-641e-4a82-966f-2b94f36d91d5 service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:09.036730 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 734/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:11.193057 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438c9e-49ad-49fb-9d96-5b37015666e4 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:11.193505 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438c9e-49ad-49fb-9d96-5b37015666e4 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:11.193595 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9438c9e-49ad-49fb-9d96-5b37015666e4 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:11.194950 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:11.200040 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1bd7-82fa-4685-a619-257798228542 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:11.200503 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1bd7-82fa-4685-a619-257798228542 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:11.200634 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b1bd7-82fa-4685-a619-257798228542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:11.207078 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=79 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:36:11.220073 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-717b1bd7-82fa-4685-a619-257798228542 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:11.221306 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-717b1bd7-82fa-4685-a619-257798228542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:11.228965 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:11.267164 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438c9e-49ad-49fb-9d96-5b37015666e4 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:11.272413 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=73 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:36:11.278039 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9438c9e-49ad-49fb-9d96-5b37015666e4 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:11.282060 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:11.283901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:11.283901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:11.283901 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:11.292298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:11.293773 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa472a9-e0a1-497d-bef7-37889885bf9e service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:11.303324 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 729/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:13.315030 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d49e-cb9e-4c0a-a6e7-fb75e12a41f8 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:13.315632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d49e-cb9e-4c0a-a6e7-fb75e12a41f8 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:13.315632 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2d49e-cb9e-4c0a-a6e7-fb75e12a41f8 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:13.317003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:13.322097 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678bfc-2d3a-49ca-a86c-705a29aa99ac None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:13.322523 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678bfc-2d3a-49ca-a86c-705a29aa99ac None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:13.322645 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678bfc-2d3a-49ca-a86c-705a29aa99ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:13.341300 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-d1678bfc-2d3a-49ca-a86c-705a29aa99ac None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:13.342449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-d1678bfc-2d3a-49ca-a86c-705a29aa99ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:13.350273 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:13.386839 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d49e-cb9e-4c0a-a6e7-fb75e12a41f8 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:13.398009 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2d49e-cb9e-4c0a-a6e7-fb75e12a41f8 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:13.401482 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:13.402105 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:13.402382 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:13.402654 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:13.411423 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:13.412909 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73e3a4-736c-4ad2-80c0-d337371a2d7a service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:13.422587 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 737/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:15.470692 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf94cb-4797-4746-9610-0bd06826c7fc None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:15.471216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf94cb-4797-4746-9610-0bd06826c7fc None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:15.471216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf94cb-4797-4746-9610-0bd06826c7fc None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:15.472548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jun 29 22:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:15.477847 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47da6-20e9-4546-8afc-4771aec7f19b None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:15.478267 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47da6-20e9-4546-8afc-4771aec7f19b None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:15.478399 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd47da6-20e9-4546-8afc-4771aec7f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:15.496033 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-2dd47da6-20e9-4546-8afc-4771aec7f19b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:15.497507 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-2dd47da6-20e9-4546-8afc-4771aec7f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:15.505518 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jun 29 22:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:15.541875 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf94cb-4797-4746-9610-0bd06826c7fc None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:15.553094 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf94cb-4797-4746-9610-0bd06826c7fc None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:15.556570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:15.557213 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:15.557495 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:15.557769 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:15.566449 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:15.567859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f494c8-4a8f-405f-b807-61ddd3de9306 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:15.577194 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 732/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:25.491229 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=11 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:36:25.572921 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=14 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:36:35.393068 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f759b-2fe9-4195-b510-7cd07c23f8fe None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:35.393642 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f759b-2fe9-4195-b510-7cd07c23f8fe None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:35.393894 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f759b-2fe9-4195-b510-7cd07c23f8fe None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:35.395272 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 739/1471] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:35.400591 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ed851-abf3-4fa8-8dba-a720a4498d0b None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:35.401028 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ed851-abf3-4fa8-8dba-a720a4498d0b None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:35.401131 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ed851-abf3-4fa8-8dba-a720a4498d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:35.418372 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-e37ed851-abf3-4fa8-8dba-a720a4498d0b None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:35.419548 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-e37ed851-abf3-4fa8-8dba-a720a4498d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:35.427722 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 733/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:35.474373 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2359a-c4ab-4fe5-9ac4-1e6304ea19c9 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:35.474688 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2359a-c4ab-4fe5-9ac4-1e6304ea19c9 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:35.474970 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2359a-c4ab-4fe5-9ac4-1e6304ea19c9 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:35.476322 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 740/1473] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jun 29 22:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:35.481295 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011557-8dc2-409a-a080-939c5ee5f1e8 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:35.481578 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011557-8dc2-409a-a080-939c5ee5f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:35.481855 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef011557-8dc2-409a-a080-939c5ee5f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:35.500350 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-ef011557-8dc2-409a-a080-939c5ee5f1e8 None None] MFA Rules not processed for user `65b5d79ac93d475ab781370bd3ca4877`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:35.501815 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-ef011557-8dc2-409a-a080-939c5ee5f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:35.508082 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 734/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jun 29 22:36:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:35.515069 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2359a-c4ab-4fe5-9ac4-1e6304ea19c9 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:35.525413 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2359a-c4ab-4fe5-9ac4-1e6304ea19c9 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:35.528922 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65b5d79ac93d475ab781370bd3ca4877', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:35.529531 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:35.529809 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:35.530565 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:35.539152 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:35.540592 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd716f-c112-4dd6-9ef9-758e5307a8d8 service glance] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:35.550343 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 741/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:37.642288 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9fcf-118e-4c2c-ab21-6217ee6779f2 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:37.642844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9fcf-118e-4c2c-ab21-6217ee6779f2 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:37.642844 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd9fcf-118e-4c2c-ab21-6217ee6779f2 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:37.644198 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 735/1476] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:37.649437 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a422-d830-4518-b769-9ce25f15d587 None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:37.649838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a422-d830-4518-b769-9ce25f15d587 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:37.649990 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769a422-d830-4518-b769-9ce25f15d587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:37.667219 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-6769a422-d830-4518-b769-9ce25f15d587 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:37.668395 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-6769a422-d830-4518-b769-9ce25f15d587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:37.676566 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 742/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:36:37.700055 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9fcf-118e-4c2c-ab21-6217ee6779f2 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:37.712190 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd9fcf-118e-4c2c-ab21-6217ee6779f2 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:37.716625 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881f643b49de4de49b74d4154b0f6d09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd834971bff2f4ef9b259002b3b3122c9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:37.717264 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:37.717576 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:37.717853 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:37.718583 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:37.720298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: WARNING py.warnings [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 29 22:36:37.720298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: warnings.warn(msg) Jun 29 22:36:37.720298 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: Jun 29 22:36:37.721474 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e876fe3-980b-40b3-9e8a-bbe1d14613bf admin admin] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:37.740626 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 736/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:36:37 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:36:39.784821 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1850-37e5-4c3a-9981-3ad63a179eff None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:39.785331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1850-37e5-4c3a-9981-3ad63a179eff None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:39.785449 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc1850-37e5-4c3a-9981-3ad63a179eff None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:39.786778 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 743/1479] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:39.792041 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd043f-62b1-41a0-9564-5c17aad6fe03 None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:39.792498 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd043f-62b1-41a0-9564-5c17aad6fe03 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:39.796615 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd043f-62b1-41a0-9564-5c17aad6fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:39.810727 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-2abd043f-62b1-41a0-9564-5c17aad6fe03 None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:39.812647 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-2abd043f-62b1-41a0-9564-5c17aad6fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:39.820426 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 737/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:39.862175 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1850-37e5-4c3a-9981-3ad63a179eff None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:39.877204 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc1850-37e5-4c3a-9981-3ad63a179eff None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:39.882694 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd620bd7c93f640ef8ec03ea691926996', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:39.883325 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:39.883607 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:39.883884 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:39.891918 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:39.893539 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96fdce-4681-4616-91cf-7d7e071bf9c7 service nova] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:39.902885 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 744/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:42.095235 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10360a-d5ba-4cca-bc0b-62915a7de649 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:42.095778 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10360a-d5ba-4cca-bc0b-62915a7de649 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:42.095905 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10360a-d5ba-4cca-bc0b-62915a7de649 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:42.097216 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 738/1482] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:42.102538 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594cec-eec8-4016-a0d9-fb06968c762a None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:42.102987 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594cec-eec8-4016-a0d9-fb06968c762a None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:42.103096 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594cec-eec8-4016-a0d9-fb06968c762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:42.121208 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-f2594cec-eec8-4016-a0d9-fb06968c762a None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:42.122418 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-f2594cec-eec8-4016-a0d9-fb06968c762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:42.130981 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 745/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:42.165741 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10360a-d5ba-4cca-bc0b-62915a7de649 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:42.176862 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10360a-d5ba-4cca-bc0b-62915a7de649 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:42.180363 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:42.181032 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:42.181314 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:42.181590 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:42.191407 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:42.192876 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda4abb3-1b0c-4c59-9303-eaf9a4bdf629 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:42.202212 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 739/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:44.294906 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f391e-0940-4949-b482-9cf7f7ebb489 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:44.295997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f391e-0940-4949-b482-9cf7f7ebb489 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:44.295997 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f391e-0940-4949-b482-9cf7f7ebb489 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:44.297362 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 746/1485] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:44.302597 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b2d-63dd-4c7b-b819-0a8326311eba None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:44.303003 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b2d-63dd-4c7b-b819-0a8326311eba None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:44.303158 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3b2d-63dd-4c7b-b819-0a8326311eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:44.320858 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-101e3b2d-63dd-4c7b-b819-0a8326311eba None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:44.322037 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-101e3b2d-63dd-4c7b-b819-0a8326311eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:44.329738 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 740/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:44.367003 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f391e-0940-4949-b482-9cf7f7ebb489 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:44.378288 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f391e-0940-4949-b482-9cf7f7ebb489 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:44.381719 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:44.382333 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:44.382612 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:44.382881 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:44.391386 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:44.392828 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d9d5a-9b3c-4e2a-ab04-8e271351dacf service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:44.401869 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 747/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:46.540859 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb40-86da-45cd-9a0a-58adc9899700 None None] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:46.541378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb40-86da-45cd-9a0a-58adc9899700 None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:46.541378 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeeb40-86da-45cd-9a0a-58adc9899700 None None] PATH_INFO: `/` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:46.542693 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 741/1488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:46.548001 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a830-bf61-4e07-9f83-4f07dd19c61f None None] REQUEST_METHOD: `POST` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:46.548456 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a830-bf61-4e07-9f83-4f07dd19c61f None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:46.548596 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96a830-bf61-4e07-9f83-4f07dd19c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:46.566757 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.auth.core [None req-8b96a830-bf61-4e07-9f83-4f07dd19c61f None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80047) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:46.567952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.fernet_utils [None req-8b96a830-bf61-4e07-9f83-4f07dd19c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80047) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:46.575725 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 748/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:46.617630 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeeb40-86da-45cd-9a0a-58adc9899700 None None] Authenticating user token {{(pid=80046) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:46.628289 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeeb40-86da-45cd-9a0a-58adc9899700 None None] Validating token access rules against request {{(pid=80046) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:46.631743 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80046) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:46.632367 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:46.632684 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:46.632960 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:46.642080 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:46.643500 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de83df4-7d83-4a21-ac4c-f6fa66346dc6 service neutron] RBAC: Authorization granted {{(pid=80046) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:46.652638 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 742/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:49.069331 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32403-46c3-4cf3-94ae-5500e2a10f35 None None] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:49.069928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32403-46c3-4cf3-94ae-5500e2a10f35 None None] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:49.069928 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32403-46c3-4cf3-94ae-5500e2a10f35 None None] PATH_INFO: `/` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:49.071317 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 749/1491] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:36:49.077011 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40248c80-1392-4f60-ac6d-ff025ca27e1e None None] REQUEST_METHOD: `POST` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:49.077463 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40248c80-1392-4f60-ac6d-ff025ca27e1e None None] SCRIPT_NAME: `/identity` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:49.077570 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40248c80-1392-4f60-ac6d-ff025ca27e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80046) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:49.094724 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.auth.core [None req-40248c80-1392-4f60-ac6d-ff025ca27e1e None None] MFA Rules not processed for user `881f643b49de4de49b74d4154b0f6d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80046) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:36:49.095897 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG keystone.common.fernet_utils [None req-40248c80-1392-4f60-ac6d-ff025ca27e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80046) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:36:49.103589 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: [pid: 80046|app: 0|req: 743/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:36:49.143060 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32403-46c3-4cf3-94ae-5500e2a10f35 None None] Authenticating user token {{(pid=80047) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:36:49.153683 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32403-46c3-4cf3-94ae-5500e2a10f35 None None] Validating token access rules against request {{(pid=80047) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:36:49.157304 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79e38a947d4a42f68cb6457ae2101234', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e4cc8fea9f74d6c9c336e41d65baf97', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80047) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:36:49.157923 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] REQUEST_METHOD: `GET` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:36:49.158203 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:36:49.158476 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80047) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:36:49.167374 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:36:49.168838 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb57ca-0ca7-4cd7-a39f-91196dba5dda service neutron] RBAC: Authorization granted {{(pid=80047) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:36:49.177952 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: [pid: 80047|app: 0|req: 750/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:36:59.089767 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: DEBUG dbcounter [-] [80046] Writing DB stats keystone:SELECT=33 {{(pid=80046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:36:59.173856 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: DEBUG dbcounter [-] [80047] Writing DB stats keystone:SELECT=33 {{(pid=80047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:38:55.794279 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: Wed Jun 29 22:38:55 2022 - graceful shutdown triggered... Jun 29 22:38:55.794741 dv-cinder-812685-13-iscsi devstack@keystone.service[80046]: Gracefully killing worker 1 (pid: 80046)... Jun 29 22:38:55.794375 dv-cinder-812685-13-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jun 29 22:38:55.795255 dv-cinder-812685-13-iscsi devstack@keystone.service[80047]: Gracefully killing worker 2 (pid: 80047)... Jun 29 22:38:56.795529 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: worker 1 buried after 1 seconds Jun 29 22:38:56.795529 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: worker 2 buried after 1 seconds Jun 29 22:38:56.796061 dv-cinder-812685-13-iscsi devstack@keystone.service[80032]: goodbye to uWSGI. Jun 29 22:38:56.797126 dv-cinder-812685-13-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jun 29 22:38:56.798172 dv-cinder-812685-13-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. Jun 29 22:44:28.342028 dv-cinder-812685-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 22:44:28.353427 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 22:44:28 2022] *** Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: nodename: dv-cinder-812685-13-iscsi Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: machine: x86_64 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: clock source: unix Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: pcre jit disabled Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: detected number of CPU cores: 4 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: current working directory: / Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: detected binary path: /usr/bin/uwsgi-core Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: your processes number limit is 47680 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: your memory page size is 4096 bytes Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: detected max file descriptor number: 2048 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: lock engine: pthread robust mutexes Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: thunder lock: enabled Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 22:44:28.354098 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 22:44:28.400070 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: Python main interpreter initialized at 0x5618e88b19c0 Jun 29 22:44:28.400070 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: python threads support enabled Jun 29 22:44:28.400070 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: your server socket listen backlog is limited to 100 connections Jun 29 22:44:28.400070 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: your mercy for graceful operations on workers is 90 seconds Jun 29 22:44:28.400525 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 22:44:28.400525 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: *** Operational MODE: preforking *** Jun 29 22:44:28.400774 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: *** uWSGI is running in multiple interpreter mode *** Jun 29 22:44:28.400774 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: spawned uWSGI master process (pid: 155855) Jun 29 22:44:28.400974 dv-cinder-812685-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 22:44:28.402067 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: spawned uWSGI worker 1 (pid: 155869, cores: 1) Jun 29 22:44:28.402067 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: spawned uWSGI worker 2 (pid: 155870, cores: 1) Jun 29 22:44:28.402067 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 22:44:33.905261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:44:33.905261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: from cryptography.utils import int_from_bytes Jun 29 22:44:33.905926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:44:33.905926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: from cryptography.utils import int_from_bytes Jun 29 22:44:33.906428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:44:33.906428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: from cryptography.utils import int_from_bytes Jun 29 22:44:33.906593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 22:44:33.906593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: from cryptography.utils import int_from_bytes Jun 29 22:44:33.954872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 22:44:33.955085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 22:44:33.955185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 22:44:33.955270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] command line args: [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 22:44:33.955507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 22:44:33.955624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] command line args: [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 22:44:33.955711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 22:44:33.955809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ================================================================================ {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 22:44:33.956033 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] admin_token = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.956288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] config_dir = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.956491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.956685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] config_source = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.956869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] debug = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.957080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 22:44:33.959352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ================================================================================ {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 22:44:33.959518 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] admin_token = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] insecure_debug = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] config_dir = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959877 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.959962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.960040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.960135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] config_source = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.960135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] debug = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.960286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.961277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.961567 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_config_append = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.961567 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.962004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.962225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_dir = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.962433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] insecure_debug = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.962637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_file = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.962839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.963065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.963271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.963492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.963709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.963924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.964137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_config_append = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.964137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.964552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.964783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_dir = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.964994 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.965200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_file = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.965512 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.965728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.965942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.966994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.967332 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.967476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.967634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.967782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.967961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968250 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] notification_format = cadf {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.968793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969109 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] publish_errors = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.969940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] notification_format = cadf {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.970819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] publish_errors = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] standard_threads = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] strict_password_check = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.971909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972098 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] use_eventlog = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972098 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] use_journal = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972585 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] use_json = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.972910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] use_stderr = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] standard_threads = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] use_syslog = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] strict_password_check = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] watch_log_file = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.973831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.973981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] use_eventlog = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.974144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.974292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] use_journal = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.974292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] use_json = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.974578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.974737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] use_stderr = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.974896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.975044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] use_syslog = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.975193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.975348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] watch_log_file = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 22:44:33.975507 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.975668 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.975816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.975972 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.976941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.977861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.978929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979235 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979658 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979815 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.979967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980459 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980772 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.980920 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.981982 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.982910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.983991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984464 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.984923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.985991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986139 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986281 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.986871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987622 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987763 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.987911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988195 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.988969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989132 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.989949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990557 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.990997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.991196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.991366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.991508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.992165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.992308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.992555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.992719 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.992863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.993954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.994192 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.994350 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.994553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.994707 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.994851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995154 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995820 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.995979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.996133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.996618 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.996791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.996936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997712 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.997997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.enabled = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998462 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.998913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999217 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.enabled = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999826 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:33.999975 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000127 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.000935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001231 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.001978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.002128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.002284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.002426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.002693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.002894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003203 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003524 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.003993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004303 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004794 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.004959 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.005871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006825 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.006984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.007147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.007842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.007997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.external = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008299 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.mapped = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008487 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.008962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.password = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.external = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009583 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] auth.token = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.mapped = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.009897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] catalog.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.password = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.010924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] auth.token = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011524 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] catalog.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.011990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.012945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013250 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013408 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.013852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014465 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.014904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.015931 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.016867 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017020 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.017924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.018967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019250 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.019985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020282 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.020990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.021952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022409 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.022873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.023997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.024959 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025415 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025415 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025690 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025832 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.025983 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026280 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.026889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.027909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028342 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.028926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029349 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.029935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030229 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030824 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.030972 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031114 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031414 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031569 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.password = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.031992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.password = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.032931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033131 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033289 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.033874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034178 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034321 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.034897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035791 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.035950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036243 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036412 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.036881 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037323 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.037916 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038230 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038568 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.038974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039573 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.039879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040133 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.040935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041774 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.041912 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042213 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.042950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.043956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044437 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] policy.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.044976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045312 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045461 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045619 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] policy.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045763 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] receipt.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.045931 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.046932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] receipt.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.047872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048647 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.048962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] revoke.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.049992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.050136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.050278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.050437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.050581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] role.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.050875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] revoke.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] role.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] role.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] role.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] role.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.051965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] role.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] role.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] role.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.052886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053321 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053646 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.053954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.054592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.054737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.054890 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.055851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056006 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.056911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.057964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058586 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.058885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059176 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.059979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060125 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.060927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061069 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.061918 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.062864 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.provider = fernet {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063020 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063450 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.063902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.provider = fernet {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.064957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] trust.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.065974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] trust.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.066987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.connection = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.067859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.connection = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.068967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.069105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.069244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.069381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.069533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.070971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071397 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.071818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.072955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=155869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 22:44:34.073801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 22:44:34.073801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=155870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 22:44:34.074333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.074490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.074640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.074797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.074945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.075086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.083408 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.083577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.111720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.112042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.114721 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.114964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.252149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.254221 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.300489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.300735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.301748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.365749 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.365996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.366255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.366425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.366611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.366764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.366923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.367092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.367092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.367381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.367381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.367381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.390902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.391971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392772 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.392953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.403257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.403624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.416247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.416556 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.416761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.416914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417561 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.417901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.418070 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=155870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.418231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.418231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.418231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=155869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 22:44:34.434739 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.434939 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:44:34.435283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.435489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:44:34.435655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.435800 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:44:34.435997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.436151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.436311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.436505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 22:44:34.436659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.436814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.436958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.437108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.437108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.437416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.448182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.448718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.448902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.449049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.449200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.449352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.449541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.457129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.457817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.461078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.461364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.461652 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.461817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.461984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.462882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463046 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463203 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.463979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.464129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.464283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.464283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.464283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.490188 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.490766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.491832 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.492116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.492442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.492730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.497661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.497944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.498227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.498378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.498555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.498830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.505773 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.506016 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.506350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.506638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.511034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.511318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.511607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.511773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.511932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.512890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.513042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.513199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.513353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.513353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.513656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.531953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.532234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.532918 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.533204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.536795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.537784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.540542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.540842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.541499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.541799 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.545950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.546927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.549589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.550576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.553237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.553542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.553841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.554987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.555141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.555416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.555703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.574234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.574521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.574791 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.575068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.575338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.575631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.575908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.576180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.582953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.584116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.584696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.584979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.586422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.586702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.588596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.588883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.589948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.590238 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.590527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.590688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.590842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.590985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.591136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.591280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.604361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.604595 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.604881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605641 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605641 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.605921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.606074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.606246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.606436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.606591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.624245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.625479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.627521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.628772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.630837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.632073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.633078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.634238 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.634856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.635147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.635441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.636027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.636309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.636621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.642785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.644439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.645950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.647570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.647755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.648501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.648762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.649043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.651419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.651715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.652009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.652293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.658253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.658543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.658830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.661568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.661847 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.662141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.666745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=155870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.667034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.667320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.667602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.667879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.668166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.668475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.668772 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.669049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.669421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.669706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.669979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.670144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=155869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 22:44:34.670297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.670442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.670594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=155870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.670737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.670935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.671216 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.671504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.671798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.672172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.672478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.672762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.673066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.673347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.673624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.673902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=155869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 22:44:34.708676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618e88b19c0 pid: 155870 (default app) Jun 29 22:44:34.712666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cdbcc-b6d7-41c5-b204-c96c9ff63228 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:34.712842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618e88b19c0 pid: 155869 (default app) Jun 29 22:44:34.712958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cdbcc-b6d7-41c5-b204-c96c9ff63228 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:34.713247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cdbcc-b6d7-41c5-b204-c96c9ff63228 None None] PATH_INFO: `/v3` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:34.717455 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jun 29 22:44:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:43.388082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:43.388723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:43.388723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:43.393066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:43.398888 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c069-037e-483f-b065-4689a8285947 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:43.399340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c069-037e-483f-b065-4689a8285947 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:43.399493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661c069-037e-483f-b065-4689a8285947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:43.470271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: INFO dbcounter [None req-5661c069-037e-483f-b065-4689a8285947 None None] Registered counter for database keystone Jun 29 22:44:43.493011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG oslo_db.sqlalchemy.engines [None req-5661c069-037e-483f-b065-4689a8285947 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=155870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 22:44:43.499994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writer thread running {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 22:44:43.679685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG passlib.handlers.bcrypt [None req-5661c069-037e-483f-b065-4689a8285947 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=155870) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 22:44:43.680029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG passlib.handlers.bcrypt [None req-5661c069-037e-483f-b065-4689a8285947 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=155870) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 22:44:43.735072 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-5661c069-037e-483f-b065-4689a8285947 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:43.736712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-5661c069-037e-483f-b065-4689a8285947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:43.862598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 29 22:44:43.886877 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:43.961285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: INFO dbcounter [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] Registered counter for database keystone Jun 29 22:44:43.981701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG oslo_db.sqlalchemy.engines [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=155869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 22:44:43.987982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writer thread running {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 22:44:44.114590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441c8d0-91aa-42e3-bc53-20184da71aa1 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:44.119014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b61017ad52497f9af5e51cae2447ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:44.119685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:44.119975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:44.120261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:44.128961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:44.181444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 22:44:44.181787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0dcb2-67a5-47ae-a460-2dd61f3077ce admin admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:44.192052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 22:44:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 22:44:44.198719 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661c069-037e-483f-b065-4689a8285947 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:44.217085 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661c069-037e-483f-b065-4689a8285947 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:44.221619 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b61017ad52497f9af5e51cae2447ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:44.222771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:44.223068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:44.223352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] PATH_INFO: `/v3/projects/c3b61017ad52497f9af5e51cae2447ec` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:44.224934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] RBAC: Authorizing `identity:get_project(project_id=c3b61017ad52497f9af5e51cae2447ec)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:44.276695 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 22:44:44.277044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fecd00-3274-42c4-b447-3411096820dc admin admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:44.281776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jun 29 22:44:44 2022] GET /identity/v3/projects/c3b61017ad52497f9af5e51cae2447ec => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:46.321239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e113ba-1420-490c-90a9-a026873fc509 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:46.321776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e113ba-1420-490c-90a9-a026873fc509 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:46.321896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e113ba-1420-490c-90a9-a026873fc509 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:46.326107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:46.331666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:46.332109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:46.332366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:46.351528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:46.353078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:46.361053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 29 22:44:46.384425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e113ba-1420-490c-90a9-a026873fc509 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:46.396549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e113ba-1420-490c-90a9-a026873fc509 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:46.400819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b61017ad52497f9af5e51cae2447ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:46.401466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:46.401755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:46.402036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:46.409873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:46.411655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80368-f45d-4400-9fbf-597bbfce8ed6 admin admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:46.421366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 22:44:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 22:44:46.426902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:46.436679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1fba7-a899-4658-84c6-3f546d47440d None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:46.441353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3b61017ad52497f9af5e51cae2447ec', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71defbe-0f4d-41d7-9e10-b48e146c7de7 admin admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:46.447837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jun 29 22:44:46 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:48.547430 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4b08-0d76-4028-899b-8ff793a2ac91 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.547998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4b08-0d76-4028-899b-8ff793a2ac91 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.547998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4b08-0d76-4028-899b-8ff793a2ac91 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.549577 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:48.555092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.555525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.555696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.572729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:48.573909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:48.586705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd457a8-f549-4358-987d-6835c441ba7d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.586996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd457a8-f549-4358-987d-6835c441ba7d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.587282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd457a8-f549-4358-987d-6835c441ba7d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.588665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:44:48.593535 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.593828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.594116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.634915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG passlib.handlers.bcrypt [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=155869) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 22:44:48.635327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG passlib.handlers.bcrypt [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=155869) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 22:44:48.661328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:48.684312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:48.684636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:48.685975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:48.709147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:48.789541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:44:48.790985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df7246-0532-45d1-bbb8-e60997960776 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:48.811893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:48.830515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:48.831333 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.831623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.831916 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.843705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:44:48.854952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:44:48.856067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:44:48.857113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:44:48.862081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:48.920657 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04497475-0f2b-420c-9a84-b7266824f4d9 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:48.923035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:48.955797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:48.958842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:48.960317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:48.960639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:48.960920 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:48.976088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fac9c7-5d72-42bf-855d-5bf733319851 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.014269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.015192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.015484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.015783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.016917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:49.016917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.018309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.035270 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:49.036434 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:49.045021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.046679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.145271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00518128-dda6-4233-9e45-10e37ade2340 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.154938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:44:49.160589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:49.164371 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:49.182386 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.183278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.183570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.183851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.185108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.186590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.188266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:44:49 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:49.193637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:49.209356 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:49.263281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4381fb-3086-40ad-9179-246ff1ada51b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.297468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d73de-25a6-4e74-accb-5b5f18eb5872 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.303802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.304636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.304938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.305208 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.324630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.326141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.337522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.338551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.339001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.339452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.340837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.342609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.344392 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:44:49.347908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:44:49.348912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:44:49.349908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:44:49.349908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:44:49.349908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:44:49.349908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:44:49.351594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:49.352055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:44:49.355411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:49.425438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:49.436940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:49.454682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad449f2-74a1-4e33-a21d-f595a610ba07 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.461643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ec5d8-af8b-42e2-be25-9ef9ba7e5459 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:49.489345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.490021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.490311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.490649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.491992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.domain.id=default, user.id=aa71dc5af58e4340b7d041e0647c6ee9) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:49.492314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.493825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20c087-91a9-41ed-806e-7ee88d873522 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.497980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:49.498663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:49.498959 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:49.499245 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:49.499984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:49.500302 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:49.501736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 22:44:49 2022] GET /identity/v3/role_assignments?user.id=aa71dc5af58e4340b7d041e0647c6ee9&scope.domain.id=default&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:49.512667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447f36-42d5-4ff8-8d5a-db3f2d65c378 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:49.523486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:51.853837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e000a-9292-46cc-86d6-5ae028426b49 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:51.854449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e000a-9292-46cc-86d6-5ae028426b49 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:51.854449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e000a-9292-46cc-86d6-5ae028426b49 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:51.855808 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:51.865199 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d93d-0973-4170-8a8c-9d6fffd3021b None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:51.866164 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d93d-0973-4170-8a8c-9d6fffd3021b None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:51.866687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6d93d-0973-4170-8a8c-9d6fffd3021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:51.905472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e3a6d93d-0973-4170-8a8c-9d6fffd3021b None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:51.907063 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e3a6d93d-0973-4170-8a8c-9d6fffd3021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:51.999686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:52.039594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e000a-9292-46cc-86d6-5ae028426b49 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:52.167611 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2debc-07a6-40c2-bbcf-b82d61b18d40 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.168255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2debc-07a6-40c2-bbcf-b82d61b18d40 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.168785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2debc-07a6-40c2-bbcf-b82d61b18d40 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.171304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:52.186108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.186735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.187245 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.190670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e000a-9292-46cc-86d6-5ae028426b49 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:52.220617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:52.224435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:52.264928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:52.266981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.270589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.271147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.293154 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:52.296096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:52.303567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:52.324928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:44:52.344684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:44:52.345785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:44:52.347380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:44:52.347380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:44:52.347380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:44:52.347380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:44:52.350399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:44:52.369391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:52.385062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:44:52.419495 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:52.539977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cd6bb-ac1b-417d-9cf4-17c5f6942651 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:52.578939 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c21d3-98a4-4ce8-9d1d-26d66a1c44d4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:52.589209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:52.590251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.590728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.591185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.618852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-0afe084f-7750-476a-b301-2f9d26b57708 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:44:52.638851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:44:52.640175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:52.641340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:44:52.643933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:44:52.645921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0a2f-541a-42ab-8627-bbd80d169a6d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.646906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0a2f-541a-42ab-8627-bbd80d169a6d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.647776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0a2f-541a-42ab-8627-bbd80d169a6d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.649584 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:52.650949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:52.651825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.652281 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.652751 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.653677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:52.654162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:52.655741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70070195-5d19-4f90-a167-050fa41c0d5b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:52.656641 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f0a2f-541a-42ab-8627-bbd80d169a6d None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:52.692246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 14/29] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:52.695598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.696929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.700147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.730268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:52.732327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:52.737652 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:52.846061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:52.869812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f0a2f-541a-42ab-8627-bbd80d169a6d None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:52.880884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:52.882368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:52.921095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:52.922067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.922529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.922978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.923894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:52.924368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:52.926019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455f59b-c422-4cbb-b81c-d47d236ff3b8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:52.939191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:52.940749 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0632-18cd-4be8-8d8a-2b21f77d56fa None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:52.941211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0632-18cd-4be8-8d8a-2b21f77d56fa None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:52.941500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0632-18cd-4be8-8d8a-2b21f77d56fa None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:52.942790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 17/32] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:52.944309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0632-18cd-4be8-8d8a-2b21f77d56fa None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:53.009258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d62d7-4eea-4321-a956-4c413d157401 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:53.044823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:53.045494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.045788 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.046078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.046802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:53.048273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c11cc-8d40-415d-9a05-66449f76ded1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:53.048878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:53.057590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0632-18cd-4be8-8d8a-2b21f77d56fa None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:53.092806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:53.093485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.093776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.094060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.094812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:53.096226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fa56b-1235-473d-94da-0dfcb1e4ef6a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:53.282650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 16/33] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:44:52 2022] POST /identity/v3/projects => generated 301 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:44:53.286198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13a2c-5d92-4dfa-a870-ac3d1abaea67 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.286776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13a2c-5d92-4dfa-a870-ac3d1abaea67 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.287785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd13a2c-5d92-4dfa-a870-ac3d1abaea67 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.289847 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 17/34] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:53.290989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd13a2c-5d92-4dfa-a870-ac3d1abaea67 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:53.324482 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:44:52 2022] POST /identity/v3/roles => generated 219 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:44:53.324955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13a6-8925-4b06-9960-02f48c8722c1 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.325404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13a6-8925-4b06-9960-02f48c8722c1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.325858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c13a6-8925-4b06-9960-02f48c8722c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.369092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-b57c13a6-8925-4b06-9960-02f48c8722c1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:53.371465 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-b57c13a6-8925-4b06-9960-02f48c8722c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:53.509864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:53.517242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 19/36] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:53.519130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.519642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.520108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.540533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:53.542002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:53.613866 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd13a2c-5d92-4dfa-a870-ac3d1abaea67 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:53.627118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 20/37] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:53.628204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:53.651194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:53.677608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:53.678539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.678833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.679123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.680504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:53.682565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:53.684418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 18/38] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:44:53 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:53.685009 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:53.744571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544d4d7-2498-4736-ac5b-80779e1b60da None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:53.781550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:53.782231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.782526 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.782815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.783569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:53.785136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:53.791865 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4696-d0c1-4ba6-973c-1e6eea79b6d0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:53.798802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:53.825561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:53.826238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.826529 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.826803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.827564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:53.828991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81d492-90b1-45ab-9894-116ae0e3ca91 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:53.873975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:44:53 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:44:53.874877 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:53.922567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 19/40] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:44:53 2022] POST /identity/v3/roles => generated 225 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:44:53.926863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7d58-06dc-4191-a71c-0d117db15ab5 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.926863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7d58-06dc-4191-a71c-0d117db15ab5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.926863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e7d58-06dc-4191-a71c-0d117db15ab5 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.926863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:53.933362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:53.933685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:53.933945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:53.958839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:53.962446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:53.987550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:54.022268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cb2df-2925-4414-b0c1-143ae7f4c149 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:54.065300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:54.077140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:54.077978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:54.078277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:54.078568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:54.080144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:54.081781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:54.085189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 22/43] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:54.089849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:54.090007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:54.202480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8e5d0-7651-42ee-aa53-e509c9548e35 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:54.206173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:54.212478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3496e-e7e2-4b77-b384-99707e4880df None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:54.236007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:54.236967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:54.237334 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:54.237629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] PATH_INFO: `/v3/domains/default/users/aa71dc5af58e4340b7d041e0647c6ee9/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:54.239916 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aa71dc5af58e4340b7d041e0647c6ee9, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:54.241947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac860-d290-4da4-85fd-12949799d71f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:54.247947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:54.248803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:54.249096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:54.249384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:54.250594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:54.252238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:54.253918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 22/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:54.260080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:54.363191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c63120-4dc2-451d-8f16-c8628da466d7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:54.401662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:54.402352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:54.402649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:54.402938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:54.403688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:54.405226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc763b4e-fb6c-42eb-bce7-cb040553959d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:54.435252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 23/45] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jun 29 22:44:54 2022] PUT /identity/v3/domains/default/users/aa71dc5af58e4340b7d041e0647c6ee9/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:44:54.498802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:44:54 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:44:56.498520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a95e-1109-4102-81ee-c38747f0bd77 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.499085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a95e-1109-4102-81ee-c38747f0bd77 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.499085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3a95e-1109-4102-81ee-c38747f0bd77 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.500485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:56.505862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.506298 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.506443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.523542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:56.524759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:56.535182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:56.547610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef4a9-1b4e-40f0-b91c-4d663e023b18 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.547915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef4a9-1b4e-40f0-b91c-4d663e023b18 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.548199 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedef4a9-1b4e-40f0-b91c-4d663e023b18 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.549604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 25/48] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:56.554815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.555112 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.555396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.566568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:56.571979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:56.573223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:56.591672 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 24/49] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:56.615454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:56.641152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 26/50] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:44:56.665181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:56.714189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee0ebf-101d-4c01-a64a-03b54e8eec70 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:56.747589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:56.748384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.748757 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.748991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.759106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:44:56.761527 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7589e-5259-47e0-94f2-fb247b8d59cc None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:44:56.766720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:44:56.767874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:44:56.768818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:44:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:44:56.777763 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:56.783368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:56.799130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:56.799942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.800231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.800559 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.801746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:56.803400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:56.805204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 27/52] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:56.810764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:56.814260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:56.874238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002c6b6-0d24-4dc4-b267-d86fa7650494 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:56.913234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:56.913913 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.914204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.914498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.914613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4c53b-f2e6-4434-b5a8-42d8e15ebf07 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:56.915286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:56.915603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:56.917077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:56.925367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:44:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:56.930755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:56.950173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:56.950846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:56.951143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:56.951432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:56.952151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:56.953676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:56.998375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:57.031596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582bbf-fc29-4cb1-a830-74f67110156a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:57.057573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 28/54] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 22:44:56 2022] POST /identity/v3/projects => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:44:57.063949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:57.064902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:57.065196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:57.065479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:57.066851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:57.068873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:57.070636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:44:56 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:44:57.076498 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:57.143567 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:57.189348 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e93fa-bfc4-44ce-9438-7ed3f5c51367 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:57.227384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:57.228198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:57.228581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:57.228874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:57.230089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:57.231580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84948ae8-17be-45d2-9159-472104dcb16a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:57.233449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:57.239113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:57.340875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6150318f-0e98-491f-86b3-859fb8c19c79 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:57.376842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:57.377510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:57.377804 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:57.378087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:57.378934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.domain.id=default, user.id=aa71dc5af58e4340b7d041e0647c6ee9) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:44:57.379254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:57.381342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf61991-6b56-4fef-9ce8-f03cd2915fb8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:57.384531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:57.387842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 22:44:57 2022] GET /identity/v3/role_assignments?user.id=aa71dc5af58e4340b7d041e0647c6ee9&scope.domain.id=default&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:59.104230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0aa8-9eff-4ab8-9a18-68ff98df1d0b None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:59.104783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0aa8-9eff-4ab8-9a18-68ff98df1d0b None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:59.104875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0aa8-9eff-4ab8-9a18-68ff98df1d0b None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:59.106214 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:44:59.111525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:59.111985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:59.112099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:59.129456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:44:59.130650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:44:59.195543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:44:59.219144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0aa8-9eff-4ab8-9a18-68ff98df1d0b None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:59.317253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e0aa8-9eff-4ab8-9a18-68ff98df1d0b None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:59.340608 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:59.351181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548ab8d-38f1-417b-98af-c2adfe0adeaa None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:59.361531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:44:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:44:59.362153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:44:59.458537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d8934-24f0-4249-bd2f-a14f13c67d31 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:44:59.486753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:44:59.492244 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:44:59.492988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:44:59.498741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:44:59.498741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:44:59.498741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:44:59.498741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cfce3-a2d5-47a8-993a-08ee8ffd1f2b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:44:59.608090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:44:59 2022] POST /identity/v3/users => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:02.829432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c1f3-b617-4a5d-87b3-5e8f0deb1bc4 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:02.830307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c1f3-b617-4a5d-87b3-5e8f0deb1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:02.830750 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c1f3-b617-4a5d-87b3-5e8f0deb1bc4 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:02.832309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:02.849056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:02.850420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:02.850890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:02.873404 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:02.874831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:02.917910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927865-1fdd-460e-95ef-ee445dd21b62 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:02.918568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927865-1fdd-460e-95ef-ee445dd21b62 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:02.919068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927865-1fdd-460e-95ef-ee445dd21b62 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:02.920701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 33/63] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:02.941333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28a21-b2e6-49a0-9cc8-051b58336425 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:02.941972 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28a21-b2e6-49a0-9cc8-051b58336425 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:02.942468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a28a21-b2e6-49a0-9cc8-051b58336425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:02.966709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:02.980292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-17a28a21-b2e6-49a0-9cc8-051b58336425 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:02.981557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-17a28a21-b2e6-49a0-9cc8-051b58336425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:02.991650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.085543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:03.087227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724921b-c1aa-4dde-96c8-01e5a521c691 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.087748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724921b-c1aa-4dde-96c8-01e5a521c691 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.088258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724921b-c1aa-4dde-96c8-01e5a521c691 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.089783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 35/66] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:03.095281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.095822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.096337 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.114190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:03.116555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:03.124851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae9f18-8110-4521-b346-fcc2b06441c5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.150904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.169561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.170667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.171130 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.171628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.183087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:03.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:03.192225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:03.193222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:03.194386 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 36/67] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:03.194386 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.195914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 32/68] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:03.209883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.257205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.307715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367dc1-ea1e-4589-adca-edd721d0acea None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.336701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba9a2-734f-47c5-acde-9d9133b4b51e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.344174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.345103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.345398 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.345677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.357014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:03.364520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:03.365621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 37/69] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:03.366538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.376806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.377492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.377789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.378080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.378855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:03.379172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.380639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f2468-61fc-4309-b5d2-98966fe085da None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.389449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 33/70] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.390601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e71-967e-47d7-aecc-00d20a7cd5e7 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.390904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e71-967e-47d7-aecc-00d20a7cd5e7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.391191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c750e71-967e-47d7-aecc-00d20a7cd5e7 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.392611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 34/71] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:03.393194 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750e71-967e-47d7-aecc-00d20a7cd5e7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.436058 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.473434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63b124-5ae1-4398-a9ed-65c274366443 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.487233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.496726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c750e71-967e-47d7-aecc-00d20a7cd5e7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.508026 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.508874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.509224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.509517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.520044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e1d9e151-d056-4135-800e-1adae0dea361 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:03.528617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:03.529852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:03.530764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 38/72] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:03.531538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405cbc-6e45-4b42-8aac-5ca4d93df398 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.531538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405cbc-6e45-4b42-8aac-5ca4d93df398 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.531538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405cbc-6e45-4b42-8aac-5ca4d93df398 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.532848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 39/73] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:03.533107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.533549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405cbc-6e45-4b42-8aac-5ca4d93df398 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.533796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.534090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.534378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.535136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:03.535451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.537437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78dd25-7e9c-4d72-9e24-7e8dcb44de99 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.547454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.548712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.549012 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.549403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.566686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:03.567928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:03.634406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 36/75] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:03.635399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.650602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405cbc-6e45-4b42-8aac-5ca4d93df398 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.666806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.685173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.686049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.686437 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.686725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.701637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.703117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e52e1b-cfdb-45a3-bc06-fc2a48d264f1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.704821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 40/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.705994 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.706285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.706569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.722166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:03.723355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:03.740881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b81d1-02ac-445b-903c-543a9e47492f None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.747578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.774737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.775420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.775712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.776001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.776803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:03.777122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.778520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.787485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 37/77] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.788279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.791061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 41/78] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:03.792536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.879482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:03.889430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017be7d-5eec-4da4-afa9-17de1e39dd5f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.897648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c56fef-785c-490c-93d9-2b96ce8677b2 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:03.923814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.924735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.925022 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.925306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.926518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.928635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.930277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 38/79] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.931035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.933309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:03.934106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:03.934397 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:03.934926 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:03.935869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:03.938056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:03.938991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:03.939745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:03.968196 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.041260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810aa714-04d0-4b90-9f86-af0d6d9725fc None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.041644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89da45-270c-4c32-9f51-310857012421 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.075466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.075655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.076118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.076426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.076527 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.076731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.076842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.077031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.078231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.079696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.085126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 43/81] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:04.085913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.110536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.150686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.152105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.187945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.193708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f52e3-0391-423b-898a-ab6a0fb69bd0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.229043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.229839 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.230129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.230415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.240421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:04.248262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:04.249499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:04.255399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:04.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 39/82] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:04.256090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.256242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 44/83] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:04.256242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.307462 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.347796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a27680-acbc-4b3d-aa48-60cd7fbd56c6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.354052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e15ce-6fb0-467b-a61b-44cf653fbca8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.381831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.382496 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.382778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.383058 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.387110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.387781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.388076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.388360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.389105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.390588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.450079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.451498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.477315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 45/84] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:04 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:04.477315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.494196 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.525120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.575307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 40/85] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:04.576521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.599479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94164272-3518-46f5-8bc1-c2f354b8571b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.640151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.640912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.641209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.641825 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.694384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16208e-94f3-4273-b1ff-11b5aa8553f5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.719415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.720875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.734551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.735708 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.736166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.736644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.738162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.739018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.740808 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.742764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 41/86] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:04.743718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.787348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:04.846643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 46/87] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:04.847655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.885786 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea32fa4-aed2-43c3-9da4-5aac249ea5fc None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.937661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:04.938767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:04.939746 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:04.940249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:04.941985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:04.942519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:04.945540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:04.958537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 42/88] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:04.960006 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:04.968418 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef3e61-3b69-4a32-88a0-2f214203c033 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:04.982836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:05.007501 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.008797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.009156 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.009604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.011001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.012664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.014665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 47/89] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.015904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:05.079550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:05.089502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463028-a827-487d-821a-d3adc09eff2e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.127593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.128461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.128902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.129288 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.130483 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:05.130873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.132436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.138532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 43/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:04 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=49628c1d18b540caa266f0e12732fa99 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.138532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:05.162264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232713d7-ce32-4b2d-be3e-17552ae39727 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.232664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.233603 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.233835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.234150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.235480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.237029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.238773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 48/91] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.240440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:05.298322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c69cd-0ee0-454e-9a80-56a4e7e209c1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.337772 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.339613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.340148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.341714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.343414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.345385 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 44/92] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.347478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:05.377490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:05.380474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:05.461686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17abcaef-b246-4a37-bdd0-6ecb778d2b3a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.499628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f646e6-5c5f-4e27-8ce8-3b95e0a7f1e6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.517254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.517921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.518207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.518488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.519336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=aa71dc5af58e4340b7d041e0647c6ee9) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:05.519652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.521679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.535310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 49/93] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/role_assignments?user.id=aa71dc5af58e4340b7d041e0647c6ee9&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.539351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:05.568689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.569387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.569665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.569948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.570801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:05.571122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.572677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.581547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 45/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=e9022c4cbdb242c5a305800f427de25b => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:05.686955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3290-8e38-4b96-8b85-0c956741def5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:05.703223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:05.731634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:05.732322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:05.732640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:05.732927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:05.836806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:05.838311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:05.960006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 50/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:05.967454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:06.079656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:06.099690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e0b75-289c-4765-83de-b2b9a69ac444 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:06.141232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:06.142111 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:06.142402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:06.142687 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] PATH_INFO: `/v3/projects/27fc61e17b494d0787f6b84349c5be86` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:06.149164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] RBAC: Authorizing `identity:get_project(project_id=27fc61e17b494d0787f6b84349c5be86)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:06.150705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34b1c8-376e-4ffe-9432-a460c7699106 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:06.152821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 46/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:05 2022] GET /identity/v3/projects/27fc61e17b494d0787f6b84349c5be86 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:06.178448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:06.198046 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:06.315273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4c547-62fd-4414-888e-03488e04da31 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:06.365185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:06.366215 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:06.366730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:06.367240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:06.368284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=27fc61e17b494d0787f6b84349c5be86, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:06.368845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:06.370545 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117e630-bd02-4559-8488-20324d29e645 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:06.377121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 51/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:06 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=27fc61e17b494d0787f6b84349c5be86&role.id=49628c1d18b540caa266f0e12732fa99 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:07.090237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5162f-4665-4dd7-b7dd-05317935c2c1 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.090801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5162f-4665-4dd7-b7dd-05317935c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.090801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5162f-4665-4dd7-b7dd-05317935c2c1 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.092211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 47/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:07.099107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8b1e-1dcf-4581-84b8-5b843b3f8e09 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.099408 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8b1e-1dcf-4581-84b8-5b843b3f8e09 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.099697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff8b1e-1dcf-4581-84b8-5b843b3f8e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.125409 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-99ff8b1e-1dcf-4581-84b8-5b843b3f8e09 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:07.126612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-99ff8b1e-1dcf-4581-84b8-5b843b3f8e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:07.214402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 52/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:07.255007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5162f-4665-4dd7-b7dd-05317935c2c1 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:07.292295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd192-ce86-4aec-b83c-9c2d5d869fb1 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.292977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd192-ce86-4aec-b83c-9c2d5d869fb1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.293514 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efd192-ce86-4aec-b83c-9c2d5d869fb1 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.295415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 53/100] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:07.314209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.314809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.315337 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.336434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:07.345366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:07.346821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:07.423124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5162f-4665-4dd7-b7dd-05317935c2c1 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:07.462949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 54/101] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:07.493730 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:07.494473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.494767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.495054 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.496620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:07.498090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:07.500031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 48/102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:07.505393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:07.517115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:07.567124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:07.693423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a314358-f945-423f-8f9f-e2f2859581c9 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:07.700384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee46ff1-cd97-4bfa-ad8c-431262050945 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:07.738427 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:07.739570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.740019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.740487 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.752019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:07.752188 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:07.752925 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.753320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.753706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.754544 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:07.756231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:07.760958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:07.762266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:07.763277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:07.765881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 49/103] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:07.772143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:07.776775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:07.867768 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:07.894369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 55/104] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:45:07 2022] POST /identity/v3/projects => generated 302 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:07.895258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024f7f6-6233-4837-9b3f-766dbdfde96e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:07.935872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:07.936928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:07.937396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:07.937841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:07.938896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:07.939395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:07.941153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7e3c-bf1f-4403-82b1-853d814196f4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:07.951378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 50/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:07.956866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.056020 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f5dc-4b2c-4e18-a2aa-93fd5c2ab36c None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.056704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f5dc-4b2c-4e18-a2aa-93fd5c2ab36c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.057240 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f5dc-4b2c-4e18-a2aa-93fd5c2ab36c None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.058857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 51/106] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:08.072901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.073591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.074109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.100515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303429e1-2050-4bc0-8644-3e373f5024c4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.101867 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:08.103593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:08.140824 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.142384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.142808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.143197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] PATH_INFO: `/v3/users/f5b94ef4038b4b5dac131ef563c82306` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.160423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b94ef4038b4b5dac131ef563c82306)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:08.163092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:08.165549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 56/107] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:07 2022] GET /identity/v3/users/f5b94ef4038b4b5dac131ef563c82306 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:08.171653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.229781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 52/108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:08.254534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:08.258997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.313421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3db8c4-5bfd-4292-be64-3308cc7248d8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.345951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:08.351500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.351939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.352239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.352561 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.377558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5512c8-ed39-40b6-bdd0-4ed18d05d481 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.420672 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.422007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.422595 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.423102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.436170 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:08.436698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:08.438225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:08.446552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:08.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:08.448552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:08.451279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 53/109] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:08.458748 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.493395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:08.559898 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:08.565878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.592265 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d64b-44ca-4be3-bb41-7c667e72ca3c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.631762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.632950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.633513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.634019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.635173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:08.635713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:08.637380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:08.639676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:08.649957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:08.656218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.696858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc204-4331-4144-8b1c-c384648f4689 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.743953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.747215 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.748961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.750142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.753165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:08.757282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:08.759500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:08.773053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:08.789547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905cd08-a805-4172-a4dd-c60ae6e9bb4f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:08.798668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:08.855481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:08.856832 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:08.857351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:08.857912 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:08.863987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:08.874996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:08.877709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 55/113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:08.887040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:09.012280 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed4983-f9dd-44ba-ac76-81f9267783f4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.037977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:09.101142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff2b1c-a0c0-4a4e-a220-e491bf7cb328 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.102345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:09.103218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.103677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.104148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.108500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f5b94ef4038b4b5dac131ef563c82306) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:09.108500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:09.108500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a96cef-a0a0-403e-924c-c3057d93ba91 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:09.117648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 59/114] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/role_assignments?user.id=f5b94ef4038b4b5dac131ef563c82306&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=a5be771f13d341a5b4eee14a62f765db => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:09.118971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7386-b1ad-4c51-ae16-96759b635eb6 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.119268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7386-b1ad-4c51-ae16-96759b635eb6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.119557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d7386-b1ad-4c51-ae16-96759b635eb6 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.121303 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 60/115] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:09.129766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967e24-8a11-4d84-9be1-21e40fbd6baa None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.130149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967e24-8a11-4d84-9be1-21e40fbd6baa None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.130399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96967e24-8a11-4d84-9be1-21e40fbd6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.174285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-96967e24-8a11-4d84-9be1-21e40fbd6baa None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:09.175513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-96967e24-8a11-4d84-9be1-21e40fbd6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:09.199816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:09.200757 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.201048 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.201335 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.202650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:09.204167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:09.212800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 56/116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:08 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:09.214090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:09.335669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 61/117] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:09.337655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76403cd-73c7-4434-8ec2-b513cbcb5059 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.337976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76403cd-73c7-4434-8ec2-b513cbcb5059 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.338255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76403cd-73c7-4434-8ec2-b513cbcb5059 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.339880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 62/118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:09.347707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.347707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.347707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.372761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:09.374389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:09.383326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:09.387895 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735632f-66b6-4dfb-a9d3-880eb3a9fad9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.430388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:09.444797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:09.445811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.446187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.446596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f31cf071e02b4d11bf022fa40a610218/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.450361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 63/119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:09.451609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:09.451976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, user_id=f31cf071e02b4d11bf022fa40a610218, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:09.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:09.554938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 57/120] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:09 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f31cf071e02b4d11bf022fa40a610218/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:09.555858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:09.623482 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b5cd4-654d-452c-a172-93dd627dbd4f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.694493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:09.695800 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.697734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.699675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.717502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:09.725580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d88992c8-2f36-41c3-bde0-a94e3df487e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:09.742436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:09.743776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:09.744827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:09.749381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 64/121] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:09.753884 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbbb75-f59a-4230-9d9e-0a244f959d65 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.756198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbbb75-f59a-4230-9d9e-0a244f959d65 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.756675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbbb75-f59a-4230-9d9e-0a244f959d65 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.759372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 65/122] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:09.761350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbbb75-f59a-4230-9d9e-0a244f959d65 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:09.788645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c71e10-6df2-40e2-aa2f-f275bb46fe3a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.832929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:09.834667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.835088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.835495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.854565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-8102ad68-d1bf-4209-b01d-f9401ee18572 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:09.865050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:09.866248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:09.867364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:09.872864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 58/123] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:09.875656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:09.876819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:09.880680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:09.912065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:09.914864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:09.977106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbbb75-f59a-4230-9d9e-0a244f959d65 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:09.978521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.001898 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 59/124] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:10.003065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.020260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.021418 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.021862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.022398 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.023318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:10.023831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.025450 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.035719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 66/125] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.045472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.112465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f7f32-40b9-478c-a8d0-27c6ef069667 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.150235 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.175432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.178887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.178887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.178887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:10.178887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.179883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.198871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc0b5-ebf8-4189-8477-5574ec3f2965 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.202634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 60/126] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.203490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.253186 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.254055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.254345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.254629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.280006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:10.293547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:10.294592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:10.295491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:10.297115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.298241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 67/127] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:10.299231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.392264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73426fe4-5edd-4813-999f-b04c15981b89 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.443219 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14b52-f5d0-493d-a795-4e78ea3f7ab4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.466145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.482225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.483418 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.483894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.484448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.485861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.487588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.490077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 68/128] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.491049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.496169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.496169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.496169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.496169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.496627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.497630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.499535 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 61/129] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.500354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.605912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3329b1-f1b5-4a67-bb71-3beae373fc15 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.658432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.659266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.659632 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.659996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.661688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:10.662082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.663679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.673115 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 69/130] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.673963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.701971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f602c13-f03d-49c5-8191-ab9f5fe17755 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.717444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.764781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.770352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.771431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.771944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.773509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.775914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.779605 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 62/131] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.782431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.797130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:10.862436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac6392-8176-4f7d-a6e7-fc0663e952e2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.948430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb475c9-ec09-4308-af22-006f31dd0aab None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:10.961244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.962058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.962351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:10.962638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:10.969172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:10.970678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:10.972640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 70/132] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:10.973205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:10.997825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:10.998734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:10.999026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.002824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.002824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.002824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.004182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 63/133] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:10 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:11.005092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:11.058581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:11.115466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe3dd1-b813-4db7-b547-22c0bd069342 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.122340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a3977-c04f-4135-9bbb-fc784d39479a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.145413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:11.154939 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.159403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.159403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.159403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/aa71dc5af58e4340b7d041e0647c6ee9/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.159946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, user_id=aa71dc5af58e4340b7d041e0647c6ee9, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.161816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5678f4-8e7e-4ccf-8936-ce4460df63d7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.165889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.167157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.167804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.168325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f31cf071e02b4d11bf022fa40a610218/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.170903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, user_id=f31cf071e02b4d11bf022fa40a610218, role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.172523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb1e9a-f467-4438-83b0-444edcb0b2f9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.250643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 64/134] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:11 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/aa71dc5af58e4340b7d041e0647c6ee9/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:11.252391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48907-1907-4b14-8073-449c18439a8a None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.252713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48907-1907-4b14-8073-449c18439a8a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.253007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48907-1907-4b14-8073-449c18439a8a None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.254623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 65/135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:11.255717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48907-1907-4b14-8073-449c18439a8a None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:11.283012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 71/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:10 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f31cf071e02b4d11bf022fa40a610218/roles/e9022c4cbdb242c5a305800f427de25b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:11.284335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.284671 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.284958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.328434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:11.328434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:11.426604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48907-1907-4b14-8073-449c18439a8a None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.444032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:11.477116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.477962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 72/137] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:11.480305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.480917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.481440 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] PATH_INFO: `/v3/projects/27fc61e17b494d0787f6b84349c5be86` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.483896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=27fc61e17b494d0787f6b84349c5be86)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.485748 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.487956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 66/138] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:11 2022] GET /identity/v3/projects/27fc61e17b494d0787f6b84349c5be86 => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:11.494625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:11.514749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:11.682181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a438-abb1-4273-a146-05f0f0013c67 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.700538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:11.706338 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660ea3-8ab5-4943-b9ca-43874881e4f6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.741210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.743061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.743061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.743061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] PATH_INFO: `/v3/projects/27fc61e17b494d0787f6b84349c5be86/users/f31cf071e02b4d11bf022fa40a610218/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.744821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] RBAC: Authorizing `identity:create_grant(project_id=27fc61e17b494d0787f6b84349c5be86, user_id=f31cf071e02b4d11bf022fa40a610218, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.746587 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79b0a8-198e-440c-81b1-0203ed5173ee None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.752349 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.753606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.754092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.754587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.756701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:11.761782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803ddec-2675-4aa7-a786-7e228df8b8f8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:11.761782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 67/139] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:11.763424 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d5fc-a926-4d0a-8e5d-c00c776c5ec6 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.763855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d5fc-a926-4d0a-8e5d-c00c776c5ec6 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.764292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d5fc-a926-4d0a-8e5d-c00c776c5ec6 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.765894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 68/140] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:11.766726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d5fc-a926-4d0a-8e5d-c00c776c5ec6 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:11.820753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:11.832076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 73/141] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:11 2022] PUT /identity/v3/projects/27fc61e17b494d0787f6b84349c5be86/users/f31cf071e02b4d11bf022fa40a610218/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:11.833689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.834165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:11.834663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:11.865762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:11.867967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:11.930052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d5fc-a926-4d0a-8e5d-c00c776c5ec6 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:11.998455 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:11.999485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:11.999940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.000388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.001305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:12.004000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a897d0-b5ae-448a-88e0-fd43f9893b6d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:12.026021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 74/142] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:12.051552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.132663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:11 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:12.166370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:12.171363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633dad8-5d72-44ac-986e-142296379ed4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:12.222423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:12.223245 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.224120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.224448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.224794 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffaa69-c08f-4908-9d63-596c6ac79a42 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.225125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffaa69-c08f-4908-9d63-596c6ac79a42 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.225410 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffaa69-c08f-4908-9d63-596c6ac79a42 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.227025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 70/144] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:12.237825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.238153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.238417 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.242298 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:12.250462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:12.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:12.252635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 75/145] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:12.259841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.279937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:12.281110 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:12.417388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 71/146] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:12.428461 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2f14-f1ae-4c5e-93ad-1f6bc8716564 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:12.476540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:12.477610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.478116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.479043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.480039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:12.480618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:12.482360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:12.491761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 76/147] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:12.497736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.501171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.525605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:12.548085 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:12.612618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6893b4-04ae-4178-9fd9-1c26362ba4a0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:12.652044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:12.653068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.653469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.653861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.667075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:12.682616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:12.684153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:12.685806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:12.688024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 77/148] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:12.696628 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.701692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f9035-8de5-4c1d-8406-ef0147a5e035 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:12.761674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:12.762597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.762882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.763159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] PATH_INFO: `/v3/users/f5b94ef4038b4b5dac131ef563c82306` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.769116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b94ef4038b4b5dac131ef563c82306)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:12.771218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:12.772931 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/users/f5b94ef4038b4b5dac131ef563c82306 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:12.779321 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.793308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:12.812840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f13d51-90da-4323-8c8f-892b1daa3bea None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:12.880267 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:12.883572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:12.883572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:12.883572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:12.883572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:12.883572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:12.884308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:12.908504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 78/150] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:12.915306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:12.980451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:12.988576 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f4a24-3e2b-4d55-9960-1dd9d219d9f4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.062439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.063633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.064797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.065253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.071728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.073389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.075292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:13.086003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:13.120490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71a202-e0ff-4c68-9232-50a107fca19a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.176015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.177966 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.178438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.178886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.180514 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.182157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.184188 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:12 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:13.199671 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:13.202032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a05b9-e5ac-4970-a489-bcc95ea5be9e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.220427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:13.244199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.245168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.245454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.245988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f5b94ef4038b4b5dac131ef563c82306/roles/a5be771f13d341a5b4eee14a62f765db` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.249152 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, user_id=f5b94ef4038b4b5dac131ef563c82306, role_id=a5be771f13d341a5b4eee14a62f765db)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.250603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.332442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342958-87d8-4ef5-a616-19ed7ca625a5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.344829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 74/153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:13 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/users/f5b94ef4038b4b5dac131ef563c82306/roles/a5be771f13d341a5b4eee14a62f765db => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:45:13.377934 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.378691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.378979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.379260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.461424 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.462979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.478071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:13.580998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:13.587847 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:13.639108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:13.729943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f4d69-9a1d-4460-906d-e00df2f4fb17 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.767272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.768149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.768453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.768736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.769961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.771516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae8fe6-afd2-4e83-ac18-ab3114235e0c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.773293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 75/155] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:13 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:13.779532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:13.907685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518058f-5fc5-4b45-96ca-d31ad4c88816 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:13.925997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:13.952953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:13.953698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:13.953986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:13.954266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:13.955171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:13.955494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:13.957004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779490dd-15a1-4d60-8efc-fdbe0bbd71c0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:13.970249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 81/156] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:13 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=49628c1d18b540caa266f0e12732fa99 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:14.561736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbae06-de55-4cab-a9d5-6271ee390286 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:14.562293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbae06-de55-4cab-a9d5-6271ee390286 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:14.562293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbae06-de55-4cab-a9d5-6271ee390286 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:14.563959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 76/157] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:14.574760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329d1a-b749-40b1-87bf-e7a91d0b5823 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:14.575078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329d1a-b749-40b1-87bf-e7a91d0b5823 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:14.575337 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1329d1a-b749-40b1-87bf-e7a91d0b5823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:14.596338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e1329d1a-b749-40b1-87bf-e7a91d0b5823 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:14.597583 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e1329d1a-b749-40b1-87bf-e7a91d0b5823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:14.686415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 82/158] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:14.701140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e933e2-1e58-4a40-947f-4559abe29b09 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:14.701422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e933e2-1e58-4a40-947f-4559abe29b09 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:14.701710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e933e2-1e58-4a40-947f-4559abe29b09 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:14.703204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 77/159] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:14.710180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:14.710474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:14.710756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:14.733510 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:14.735664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e933e2-1e58-4a40-947f-4559abe29b09 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:14.746740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:14.887038 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:14.935234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:14.939974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:14.956432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e933e2-1e58-4a40-947f-4559abe29b09 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:14.996525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:14.997395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:14.997684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:14.997964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.002010 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:15.011042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:15.020161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:15.021783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:15.022738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 78/161] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:15.032613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:15.134110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e406e-9274-42b4-8eec-efe33010d665 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.198150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.199540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.200043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.200566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.220327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:15.229319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:15.230364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:15.231317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:15.233134 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9ae1f-c6a6-49a1-bda8-622453db6572 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.234197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 84/162] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:15.241088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:15.352023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.353158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.353878 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.355011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.356015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:15.356781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:15.358490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:15.385338 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:15.401848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:15.437855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:15.502097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:15.519779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baeb7c3-4ae4-4153-be6b-240e196a297d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.571693 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc068bc-f770-487f-83d4-c58bdef26676 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.609205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.610591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.611099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.611590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.612581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:15.613098 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:15.615097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:15.621597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.623193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.623696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.624210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] PATH_INFO: `/v3/users/aa71dc5af58e4340b7d041e0647c6ee9` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.626215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] RBAC: Authorizing `identity:get_user(user_id=aa71dc5af58e4340b7d041e0647c6ee9)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:15.627903 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:15.630470 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 80/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/users/aa71dc5af58e4340b7d041e0647c6ee9 => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:15.631699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 85/165] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:15.637164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:15.637313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:15.773571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:15.793541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978818b2-4122-4f04-ac40-86528b20c355 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.837266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.838627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.839159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.839666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.858607 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d79323-9a67-4ad4-8613-fdaa245f0300 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:15.954494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:15.955391 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.955685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.955970 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.961119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:15.962625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dce15-9d67-4b62-b492-b3bb98223874 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:15.964489 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 86/166] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:15.965397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:15.965573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63021d-57da-49e7-90b8-e4a0964e8879 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:15.965836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63021d-57da-49e7-90b8-e4a0964e8879 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:15.966127 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63021d-57da-49e7-90b8-e4a0964e8879 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:15.967643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 87/167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:15.967928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ee13b-5974-4848-a041-d58f282a9bbe None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:15.972305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63021d-57da-49e7-90b8-e4a0964e8879 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.028771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.114475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.139155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63021d-57da-49e7-90b8-e4a0964e8879 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:16.147934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 81/168] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:16.149559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.153146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.182277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:16.184005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:16.206241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:16.206913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.207207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.207496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.293074 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:16.294495 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:16.306967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:16.308121 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.328798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.422423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 88/170] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:16.423299 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.536388 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c40b3-778f-45de-89de-b7acccaf66ec None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:16.550655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2aebdb-1aa0-450f-951b-7a305c87e6d1 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:16.580774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.581410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.606899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:16.610440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.610440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.610440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.625482 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:16.634059 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:16.634932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.635219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.635502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.636765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:16.638245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:16.640298 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 83/171] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:16.641109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:16.642177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:16.643404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:16.644367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 89/172] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:16.651922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.828086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399bd0-ebad-41fb-9258-ef89b91250a4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:16.834081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded44ea-07c8-4548-8696-9da71cea576a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:16.872909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:16.873803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.874225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.874516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.876172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:16.877935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:16.879938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 84/173] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:16.880883 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:16.881879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.882394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.882888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.883947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:16.884509 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:16.886081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.886515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e57aa2-70ee-44a3-b11e-401f0f042e63 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:16.901057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:16.902664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646385-4895-4e58-bd7a-55ac26adf0a7 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.903190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646385-4895-4e58-bd7a-55ac26adf0a7 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.903684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34646385-4895-4e58-bd7a-55ac26adf0a7 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.905329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 91/175] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:16.907175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa56-76a0-4154-80f8-b73a3b8320a1 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:16.907707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa56-76a0-4154-80f8-b73a3b8320a1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:16.908644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90aa56-76a0-4154-80f8-b73a3b8320a1 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:16.910445 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 92/176] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:16.912287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90aa56-76a0-4154-80f8-b73a3b8320a1 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:16.955426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:16.976438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.015067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54591b-f739-4213-ae98-0068a6168cf1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.050615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90aa56-76a0-4154-80f8-b73a3b8320a1 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.054187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.054387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.054845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.055224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.056213 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=aa71dc5af58e4340b7d041e0647c6ee9) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:17.056645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.058198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.068380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 85/177] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/role_assignments?user.id=aa71dc5af58e4340b7d041e0647c6ee9&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:17.069538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.126000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.127098 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.127639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.128304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.132378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:17.133038 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.134759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3522a5-c485-42fe-8b1a-7abc5df77db7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.147788 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 93/178] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:16 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=e9022c4cbdb242c5a305800f427de25b => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:17.149225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b29d4-97e4-4159-8e97-6d980985bb76 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.149520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b29d4-97e4-4159-8e97-6d980985bb76 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.149817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b29d4-97e4-4159-8e97-6d980985bb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.184656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-160b29d4-97e4-4159-8e97-6d980985bb76 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:17.187019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-160b29d4-97e4-4159-8e97-6d980985bb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:17.250447 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18e0ce-6e49-4fb9-bc41-b3102c662412 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.267704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.283790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 94/179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:17.285162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022185e-dec8-4459-ac9b-5795dfde057d None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.285459 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022185e-dec8-4459-ac9b-5795dfde057d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.285789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022185e-dec8-4459-ac9b-5795dfde057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.299402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.300318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.302810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.302810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] PATH_INFO: `/v3/users/f31cf071e02b4d11bf022fa40a610218` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.303175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] RBAC: Authorizing `identity:get_user(user_id=f31cf071e02b4d11bf022fa40a610218)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.304878 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407400f9-344f-4884-97c9-c92d92a32dbf None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.306932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 86/180] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/users/f31cf071e02b4d11bf022fa40a610218 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:17.307972 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-2022185e-dec8-4459-ac9b-5795dfde057d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:17.308315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a7d9-d270-44a1-8249-8b2f6fd6471d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.308696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a7d9-d270-44a1-8249-8b2f6fd6471d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.309013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288a7d9-d270-44a1-8249-8b2f6fd6471d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.309476 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-2022185e-dec8-4459-ac9b-5795dfde057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:17.310497 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 87/181] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:17.311481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed276f5-d216-4e31-94db-c533229fe128 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.316546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed276f5-d216-4e31-94db-c533229fe128 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.316861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed276f5-d216-4e31-94db-c533229fe128 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.320107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 88/182] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:17.321113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed276f5-d216-4e31-94db-c533229fe128 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.359688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.398532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 95/183] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:17.399762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.400184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.400503 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.417207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:17.418406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:17.444007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed276f5-d216-4e31-94db-c533229fe128 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.479355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.480154 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.480482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.480771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.485362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:17.486192 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.491787 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-18c48405-e794-4c77-a7b1-e4117e0179aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:17.499753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:17.500828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:17.501753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 89/185] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:17.502520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.502520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.503507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.519593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:17.520864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:17.555323 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.586076 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 90/186] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:17.589269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.591086 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.595305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198142a-de8c-4f9a-a2d3-d6192b09c065 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.631842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.633080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.633080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.633080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.687983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288c0f-d942-448e-bc4a-9a392c2ba6fc None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.702227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.703718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.720964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.722088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.722378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.722656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.723836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.725303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.726925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 91/187] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:17.731702 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.772063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.823185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.827108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 97/188] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:17.829096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.833591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e497d9c-7982-4281-98eb-c0b9322c68af None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.870114 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.871044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.871334 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.871617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.872441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:17.881383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:17.881383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:17.884304 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 92/189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:17.885428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:17.936234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e2ae4-5cab-4bf3-b8c9-23c6b21c62ba None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.972605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:17.973828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:17.974115 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:17.974401 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:17.984336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:17.986571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59394b14-321d-4cb0-9358-1d3a078d8ca6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:17.988076 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:17.993004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:17.994065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 98/190] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:17.995061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.024277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.025208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.025495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.025785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.037206 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:18.045060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:18.046108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:18.047014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 93/191] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:18.047765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.058737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.102329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71889fff-1913-4893-9bb5-fbc751edb62e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.135745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.136440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.136730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.137011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.137723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.139191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.146403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a349f-5039-434a-8e16-de9c199b75c4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.180700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.181626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.181922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.182209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] PATH_INFO: `/v3/projects/27fc61e17b494d0787f6b84349c5be86` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.183414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] RBAC: Authorizing `identity:get_project(project_id=27fc61e17b494d0787f6b84349c5be86)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.184918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.186766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 94/192] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/projects/27fc61e17b494d0787f6b84349c5be86 => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.187529 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.217687 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.238170 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 99/193] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:17 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:18.239039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.303325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7eba6-db2e-4ae8-a0dd-44c3811aefb3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.342932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.343837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.344158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.344468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.360166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb526395-587b-4f48-9b6e-cf29d6d931cd None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.360482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.361951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.363915 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 95/194] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.364563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.385029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.405933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.406718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.407079 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.407436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.409739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:18.409739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.410251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.420605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 100/195] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.421534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.463147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.479045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2599a60-cd61-4f11-88bc-c54d78665dde None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.521452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.522062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.522357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.522652 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.523432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:18.523862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.525319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.537651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 96/196] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.538297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.546590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd2349-2aa4-45ae-b6ef-09beea92aced None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.589335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.590437 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.590896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.591220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.592081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=27fc61e17b494d0787f6b84349c5be86, user.id=f31cf071e02b4d11bf022fa40a610218) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:18.592452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.594147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.603020 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 101/197] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/role_assignments?user.id=f31cf071e02b4d11bf022fa40a610218&scope.project.id=27fc61e17b494d0787f6b84349c5be86&role.id=49628c1d18b540caa266f0e12732fa99 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.604327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.659273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7e6a6-67ea-4d8f-802d-eed54a58bca8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.668909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.698812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.699939 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.700521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.701025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.723429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:18.758782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72094c-56e8-40f1-99d3-dff91c0cf074 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.794315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.797443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.846257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:18.847596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:18.848149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:18.848743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:18.850535 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:18.852343 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:18.854086 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:18.854983 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.943519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 97/199] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:18.944441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:18.976182 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bb432-6d4b-42e3-be88-74a7aefad609 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:18.989263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.003292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.017696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.018949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.019456 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.019916 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] PATH_INFO: `/v3/users/f5b94ef4038b4b5dac131ef563c82306` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.021375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] RBAC: Authorizing `identity:get_user(user_id=f5b94ef4038b4b5dac131ef563c82306)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.025564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.025564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/users/f5b94ef4038b4b5dac131ef563c82306 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:19.025564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.061001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a60fa-9b9b-4efb-8314-4c15e38f348a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.105812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.107267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.107572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.107867 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.144853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba284-e5cb-4507-9d3c-3b7ef10870e4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.189396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.190670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.191195 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.191690 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.193808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.195488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.196177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.197703 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.198093 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 104/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:19.199148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.255352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.265601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.319461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 98/202] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:19.320894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.327893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808066c-03bd-43c6-b040-d0b2bb9ebd11 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.380330 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.381029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.381325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.381612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.438986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246380d-116a-4b69-ba6c-81aeedea8e99 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.470339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.472502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.482357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.483627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.484000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.484365 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.485326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=15b84243ad494cdc91dad53eefe5fc3f) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:19.485744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.488179 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.496205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 99/203] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/role_assignments?user.id=15b84243ad494cdc91dad53eefe5fc3f&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:19.501201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.536784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.567941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.677145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 105/204] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:19.678037 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.718198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a97085a-f3b9-4642-b174-9715731d25fd None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.790004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.792089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.792089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.792089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.792632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.794093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.796223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:19.801412 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.806958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36da6d-ffb4-4358-89ed-8f436bf315e6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:19.845717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429779ef-9748-483c-abf7-941298ed06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:19.846956 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429779ef-9748-483c-abf7-941298ed06df None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:19.847613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429779ef-9748-483c-abf7-941298ed06df None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:19.848822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429779ef-9748-483c-abf7-941298ed06df None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:19.850306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429779ef-9748-483c-abf7-941298ed06df None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:19.852069 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429779ef-9748-483c-abf7-941298ed06df None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:19.854537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 106/206] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:19.860816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429779ef-9748-483c-abf7-941298ed06df None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:19.901880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.951139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:19.986083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d3c5-4c1e-4ea0-bcad-c6f9008f814f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:20.051909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:20.052649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.054293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.054590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.055458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=15b84243ad494cdc91dad53eefe5fc3f) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:20.055786 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:20.057293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644b880-e61b-4758-bd1f-7d1f6d35d5ce None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:20.072294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429779ef-9748-483c-abf7-941298ed06df None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:20.074900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/role_assignments?user.id=15b84243ad494cdc91dad53eefe5fc3f&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:20.115160 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:20.115845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.116138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.116449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.117316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a, user.id=f5b94ef4038b4b5dac131ef563c82306) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:20.117638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:20.119135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460dc060-27a0-4ed9-ba9e-eae59b8805a6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:20.131565 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:19 2022] GET /identity/v3/role_assignments?user.id=f5b94ef4038b4b5dac131ef563c82306&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=a5be771f13d341a5b4eee14a62f765db => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:20.614814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134373-287b-4ca3-85e5-9ad07b383c9e None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.615549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134373-287b-4ca3-85e5-9ad07b383c9e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.616052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a134373-287b-4ca3-85e5-9ad07b383c9e None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.617973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:20.623802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8936a-ef4b-462b-8a43-06341af0b32d None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.624433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8936a-ef4b-462b-8a43-06341af0b32d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.624947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8936a-ef4b-462b-8a43-06341af0b32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.646388 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-fba8936a-ef4b-462b-8a43-06341af0b32d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:20.647594 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-fba8936a-ef4b-462b-8a43-06341af0b32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:20.719533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 108/210] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:20.744597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a134373-287b-4ca3-85e5-9ad07b383c9e None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:20.746764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7347d1-cb5d-4a47-91ff-ba70a09e0a10 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.747061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7347d1-cb5d-4a47-91ff-ba70a09e0a10 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.747343 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7347d1-cb5d-4a47-91ff-ba70a09e0a10 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.748767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 109/211] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:20.756254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.756575 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.756864 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.776141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:20.777370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:20.779457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:20.855545 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:20.881921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:20.900632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a134373-287b-4ca3-85e5-9ad07b383c9e None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:20.948615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:20.949848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:20.950420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:20.950711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:20.963924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:20.974450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:20.975530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:20.976744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:20.982857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:20.996758 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.011763 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20adf-081d-44c5-b7b4-d6966dd6d163 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.057550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.058961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.059665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.060129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.062147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.064300 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.066846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:21.072433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:21.083517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.122383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a64a5-f0dd-4906-9d71-125db0fc5222 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.172021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.173103 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.173403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.173695 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.174735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:21.175062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.177327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.193848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 104/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:21.195583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:21.198297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd485224-0463-489d-ab40-f811d8454e6d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.235936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.237082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.237599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.238145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.239190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.240935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.273751 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.307933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1fc59-acad-45cc-b62d-338cf27c9831 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.315516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 112/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:21 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:45:21.354672 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.356076 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.356636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.357191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] PATH_INFO: `/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.374752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] RBAC: Authorizing `identity:get_user(user_id=ae8c1249d47a4ff4a521a6fa60b355fc)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.376876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.379419 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 105/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:21 2022] GET /identity/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:21.385618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:21.461097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.506638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21cb3d-fee0-4436-9613-bcbe8d7b1966 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.543678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.544345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.544735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.545020 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.615165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.616693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fc2ce-2d44-406c-8ccf-bed25800d19d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.688207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.734690 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 113/218] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:21.740545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:21.804941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6beb-8882-4cdd-8b26-835e05629407 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.805307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6beb-8882-4cdd-8b26-835e05629407 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.805525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6beb-8882-4cdd-8b26-835e05629407 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.807059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 114/219] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:21.815235 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.815538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.815822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.842999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:21.844374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:21.872874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdd004-88e7-467e-812e-eaeb0927672e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:21.903102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:21.918296 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:21.922097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:21.922097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:21.922097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:21.926928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:21.928738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:21.931104 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 106/220] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:21 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:21.937438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:21.996555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 115/221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:22.066006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.121215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcdc86-323c-4e93-ac36-f45ecc2fd365 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.182755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.183438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.183731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.184019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.184915 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=ae8c1249d47a4ff4a521a6fa60b355fc) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:22.185240 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:22.186713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:22.194588 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 107/222] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:21 2022] GET /identity/v3/role_assignments?user.id=ae8c1249d47a4ff4a521a6fa60b355fc&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=49628c1d18b540caa266f0e12732fa99 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:22.223082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:22.234578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8bbce-547b-4e38-96d5-75bc56ad8b21 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.280851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.281563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.281858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.282141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.299943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-1e5286e9-9dde-4ec2-8158-10015d8ea6ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:22.308374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:22.309511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:22.310446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 116/223] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:22.318517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.333105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6e82f-91d5-4f1e-9936-0eb42b0583c1 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.333464 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6e82f-91d5-4f1e-9936-0eb42b0583c1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.333673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6e82f-91d5-4f1e-9936-0eb42b0583c1 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.337658 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 117/224] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:22.343479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345477ab-341f-47bf-9173-5d10561746ee None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.343794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345477ab-341f-47bf-9173-5d10561746ee None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.344042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345477ab-341f-47bf-9173-5d10561746ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.374892 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-345477ab-341f-47bf-9173-5d10561746ee None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:22.378337 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-345477ab-341f-47bf-9173-5d10561746ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:22.453970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:22.476441 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 118/225] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:22.505759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345477ab-341f-47bf-9173-5d10561746ee None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.524052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a8eb4-2928-4912-ba6a-2537bba5a92f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.594962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.595650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.595945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.596225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.597032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:22.597349 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:22.599251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:22.619778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 108/226] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:22.625486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.646674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:22.655508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345477ab-341f-47bf-9173-5d10561746ee None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.693048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.694431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.694874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.695165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.706564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:22.716025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:22.717097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:22.718017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 119/227] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:22.725656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.853772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1441e5-6bb5-4d12-9843-2052d99b01a8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.864108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1262d-ba0b-46d3-9c11-0ebb3eca9b16 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:22.904891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:22.909490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.911167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.911658 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.912179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.913278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:22.913838 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:22.916262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:22.929135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 120/228] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:22.939021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.939150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:22.939150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:22.939150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:22.939150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:22.942169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:22.947600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:22.951980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 109/229] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:22.960223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:22.972889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:23.086155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42da2d6-84da-4ae1-82b8-ce2bc9b2e5e3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:23.124802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:23.126211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.126507 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.126796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.128192 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:23.131004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:23.133359 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 121/230] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:23.143969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:23.186572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba237b59-e881-44d6-aaf0-a2ce2e0ae4c4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:23.256680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:23.257564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.258143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.260297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:23.261814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:23.264581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 110/231] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:22 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:23.276768 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:23.278859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:23.344049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464d525-449c-43a9-ae32-27b6f0d9bd8a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:23.376847 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:23.411216 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:23.412144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.412521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.412807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.415928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:23.417426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:23.419166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 122/232] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:23 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:23.424857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:23.462393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c989c6f-bac6-43a8-94e0-f5bd42b2e9ca None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:23.507926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:23.508873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.509165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.509458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/users/15b84243ad494cdc91dad53eefe5fc3f/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.511547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, user_id=15b84243ad494cdc91dad53eefe5fc3f, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:23.513109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec259324-547c-4b04-a00b-76ab72a1c5cc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:23.587325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed705-abce-4fd2-8001-b53fa95be339 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:23.623762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:23.624707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.624999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.625283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/users/15b84243ad494cdc91dad53eefe5fc3f/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.627631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, user_id=15b84243ad494cdc91dad53eefe5fc3f, role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:23.629191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1153cdc-d359-4dfd-9625-96d7079250d5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:23.640217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 111/233] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:23 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/users/15b84243ad494cdc91dad53eefe5fc3f/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:23.755609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:23.760819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 123/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:23 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/users/15b84243ad494cdc91dad53eefe5fc3f/roles/e9022c4cbdb242c5a305800f427de25b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:23.880278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5902e7-e6dc-49df-93fa-5d58b9c922f8 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.880504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5902e7-e6dc-49df-93fa-5d58b9c922f8 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.880800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5902e7-e6dc-49df-93fa-5d58b9c922f8 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.882842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 112/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:23.888438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b5331-fb06-4ddd-aa6e-c562109eb80e None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:23.888950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b5331-fb06-4ddd-aa6e-c562109eb80e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:23.889048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b5331-fb06-4ddd-aa6e-c562109eb80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:23.914280 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-5f2b5331-fb06-4ddd-aa6e-c562109eb80e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:23.915491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-5f2b5331-fb06-4ddd-aa6e-c562109eb80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:24.013852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 124/236] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:24.046631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5902e7-e6dc-49df-93fa-5d58b9c922f8 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.143538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351dc3-f906-46bb-a716-5590718e62c2 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.143758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351dc3-f906-46bb-a716-5590718e62c2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.144024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a351dc3-f906-46bb-a716-5590718e62c2 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.146925 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 125/237] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:24.151209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.151500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.151784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.168698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5902e7-e6dc-49df-93fa-5d58b9c922f8 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.171470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:24.172709 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:24.193325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:24.219858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.220696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.220987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.221267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.248935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:24.256848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:24.257857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:24.258802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 113/238] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:24.271399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.290247 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 126/239] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:24.317411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.400544 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862232-e7dd-4a11-a643-9339801620af None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.440880 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.441606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.441895 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.442177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.442934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:24.443245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:24.444662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:24.454980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:24.461319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 114/240] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:24.469369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.511858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:24.532328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8309e-1ae8-498e-82f2-6ab2a3d52bb7 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.576461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ba474-09bd-4b61-a256-83c078f7c2a9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.602871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.603679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.603962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.604240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.606499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:24.607985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:24.610751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 127/241] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:24.616845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.632205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.633117 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.633405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.633684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] PATH_INFO: `/v3/users/6afbc22c72c54f9e89c86319f61b2a40` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.657052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=6afbc22c72c54f9e89c86319f61b2a40)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:24.658448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040162c-d4a4-441c-b175-54b805585ee4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:24.660498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 115/242] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:24 2022] GET /identity/v3/users/6afbc22c72c54f9e89c86319f61b2a40 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:24.661755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5cf6-b1c9-4e3d-8321-2583247b95d7 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.662044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5cf6-b1c9-4e3d-8321-2583247b95d7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.662328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5cf6-b1c9-4e3d-8321-2583247b95d7 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.663563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 116/243] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:24.668142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5cf6-b1c9-4e3d-8321-2583247b95d7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:24.745125 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67510-0289-477f-a826-fbfd516bc4c7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.774318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:24.782655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.783496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.783617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.784637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.785124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:24.786845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90e810-cf89-4fbd-a0d2-9249bf7e3537 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:24.798259 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:24.805820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5cf6-b1c9-4e3d-8321-2583247b95d7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:24.840978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:24.841736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.842030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.842407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.869781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 128/244] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:24 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:24.871904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:24.872202 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:24.873191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:24.905613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:24.907974 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:24.922506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:24.924197 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:24.987312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 129/245] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:25.035008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:25.036319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.044452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 117/246] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:25.051945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.176635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0896-6f84-454e-a31e-2595b6f9fa55 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.191284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a8c9b-a03a-4fa3-9ac9-f4a6a995dbc4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.212010 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:25.224838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.226138 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.226636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.227089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.228586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:25.230149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:25.232271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 118/247] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:25.235761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.237121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.237646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.238134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.239043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.253789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:25.267752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:25.268903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:25.269900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:25.274290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 130/248] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:25.277333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.333350 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:25.385458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851bc1c7-7178-4b51-b95d-d683e88d8679 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.435479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.436079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.436373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.436698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b1d9f-ba47-4af6-aebf-8ba94fceee02 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.436829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.437547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=6afbc22c72c54f9e89c86319f61b2a40) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:25.437874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:25.440624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:25.448745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 119/249] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/role_assignments?user.id=6afbc22c72c54f9e89c86319f61b2a40&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=a5be771f13d341a5b4eee14a62f765db => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:25.484355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.485171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.485508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.485797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.486571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:25.486887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:25.489005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:25.499790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 131/250] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:25.505396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.621122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba8ac5-ce72-469a-aa1f-cb8df1f332b4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.652805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:25.658239 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.659145 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.659436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.659722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] PATH_INFO: `/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.661571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] RBAC: Authorizing `identity:get_user(user_id=ae8c1249d47a4ff4a521a6fa60b355fc)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:25.663035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:25.665087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 120/251] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:25.670621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.716239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:25.791259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8630-f33c-4f07-b193-da5396cdfc36 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:25.831238 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba6444-eb5d-4460-bf6c-07b591ac1575 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:25.840288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 132/252] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:25 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:25.843437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:25.991807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002d0f-2f53-4274-b545-76798ba1c258 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:26.036165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:26.037582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.038211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.038957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/users/ae8c1249d47a4ff4a521a6fa60b355fc/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.043046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, user_id=ae8c1249d47a4ff4a521a6fa60b355fc, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:26.045232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90270633-5ed4-434c-af6e-a103cef5e8ec None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:26.169988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 121/253] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:25 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/users/ae8c1249d47a4ff4a521a6fa60b355fc/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:45:26.332880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c224b-f711-4c7e-96f6-3ccc0d10c4d9 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.333998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c224b-f711-4c7e-96f6-3ccc0d10c4d9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.334531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c224b-f711-4c7e-96f6-3ccc0d10c4d9 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.336645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 133/254] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:26.343206 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7f75-9ff0-4671-8a8e-5437da6cab9c None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.343862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7f75-9ff0-4671-8a8e-5437da6cab9c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.344359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd7f75-9ff0-4671-8a8e-5437da6cab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.377032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-90dd7f75-9ff0-4671-8a8e-5437da6cab9c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:26.379752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-90dd7f75-9ff0-4671-8a8e-5437da6cab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:26.458116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:26.482379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 122/255] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:26.526727 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c224b-f711-4c7e-96f6-3ccc0d10c4d9 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:26.631439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643948-e4f9-424e-9f27-eaf3aeb05c6d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.631639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643948-e4f9-424e-9f27-eaf3aeb05c6d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.631914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31643948-e4f9-424e-9f27-eaf3aeb05c6d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.633347 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 123/256] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:26.638460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.638759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.639184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.670037 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c224b-f711-4c7e-96f6-3ccc0d10c4d9 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:26.677440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:26.681444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:26.686621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:26.737092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:26.737911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:26.738202 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:26.739148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:26.758067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:26.765912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:26.766990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:26.767950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:26.773081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 134/257] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:26.779006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:26.855084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 124/258] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:26.879594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.018406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85ace2-46a6-43f2-8897-f8c1f7b76d84 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.082413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.083094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.083382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.083663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.084430 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:27.084758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.086155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:27.098471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 135/259] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:27.104489 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.110452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a18dc-ec56-40f0-b361-d0577944c75a None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.140936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:27.143383 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:27.172190 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.173084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.173375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.173722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.189254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:27.204358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:27.205467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:27.206406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 125/260] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:27.211887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.229279 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac0a58-c595-47ae-bbfd-f0392d32ae07 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.278076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.279019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.279313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.279593 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.285204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.287189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:27.289234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 136/261] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:27 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:27.294427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.409413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57697-08f5-45f0-8eb9-b642b2f26fd6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.489106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.489807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.490099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.490383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.491152 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:27.491468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.492924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:27.507770 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 126/262] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:27.513580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.523939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:27.540223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23540865-0691-480e-b8cb-637c8c483f17 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.594841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:27.622733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.623405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.623698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.623977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.685074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b40c2-6bea-4bb0-bed7-ff92520ee855 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.720502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.721383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.721670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.721947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] PATH_INFO: `/v3/users/15b84243ad494cdc91dad53eefe5fc3f` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.723684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] RBAC: Authorizing `identity:get_user(user_id=15b84243ad494cdc91dad53eefe5fc3f)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.725221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:27.727250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 127/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:27 2022] GET /identity/v3/users/15b84243ad494cdc91dad53eefe5fc3f => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:27.732584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:27.797486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.798991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:27.839293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3cfee-34e6-4499-9864-4f486fab3e2f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:27.847409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:27.877156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:27.877833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:27.878178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:27.878478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:27.963981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:27.965900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:28.013278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:28.029000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:28.038951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.120966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 128/265] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:28.122156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.138883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:28.247620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636aed9-0aef-4ab2-b5ee-a0545d3096d9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:28.280001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e7d50-08a4-449b-900a-0a7c6bc7d83d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:28.315884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:28.317091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.317540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.318001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.319367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:28.321039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4855ad3-f5ab-4f94-8490-3ba98fb0283c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:28.322985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 129/266] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:28.324387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e265eb-080f-41fc-bc09-5f5dcc749193 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.324868 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e265eb-080f-41fc-bc09-5f5dcc749193 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.329854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e265eb-080f-41fc-bc09-5f5dcc749193 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.331429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 130/267] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:28.332865 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e265eb-080f-41fc-bc09-5f5dcc749193 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.357142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:28.358106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.358314 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.358604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.365165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:28.366693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ac0f5-9eec-4bcd-9eaa-5b5e00febfce None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:28.368778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 138/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:28.370008 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a95d61-bc69-4053-8af0-3f21d3d94e78 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.370318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a95d61-bc69-4053-8af0-3f21d3d94e78 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.370832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a95d61-bc69-4053-8af0-3f21d3d94e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.422132 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-77a95d61-bc69-4053-8af0-3f21d3d94e78 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:28.423353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-77a95d61-bc69-4053-8af0-3f21d3d94e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:28.429549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:28.440530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e265eb-080f-41fc-bc09-5f5dcc749193 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:28.476662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:28.477643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.478180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.478614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.479612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=15b84243ad494cdc91dad53eefe5fc3f) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:28.480084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:28.481846 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:28.492613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 131/269] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/role_assignments?user.id=15b84243ad494cdc91dad53eefe5fc3f&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:28.493907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.617529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:28.635435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5f892-2a92-48f5-9c46-fefe90ddb298 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:28.640618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 139/270] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:28.641865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef679c1-68c7-41a5-a137-4b39c6bde324 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.642167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef679c1-68c7-41a5-a137-4b39c6bde324 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.642454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef679c1-68c7-41a5-a137-4b39c6bde324 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.645798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 140/271] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:28.658720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509092-c19b-4a19-9883-cb81299e11c2 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.659368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509092-c19b-4a19-9883-cb81299e11c2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.660130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99509092-c19b-4a19-9883-cb81299e11c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.699074 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-99509092-c19b-4a19-9883-cb81299e11c2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:28.701962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-99509092-c19b-4a19-9883-cb81299e11c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:28.719355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:28.720509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.722991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.723552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.724706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=15b84243ad494cdc91dad53eefe5fc3f) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:28.725286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:28.727015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:28.740987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 132/272] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/role_assignments?user.id=15b84243ad494cdc91dad53eefe5fc3f&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:28.742212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.750709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:28.824648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:28.827283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f05d-dd40-4125-88e7-d3c0524cbb6e None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.828128 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f05d-dd40-4125-88e7-d3c0524cbb6e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.828644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f05d-dd40-4125-88e7-d3c0524cbb6e None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.831697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 142/274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:28.837657 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.838251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.839081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.864588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:28.866605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:28.907746 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b7e7a2-2a20-4f61-a829-0da0bfc29aeb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:28.953982 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:28.954797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:28.955088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:28.955371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:28.965654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 143/275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:28.966852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:28.972066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:28.980361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:28.981451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:28.982409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 133/276] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:28.990559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.029440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.069585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.095921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b95c5-f30e-4b9f-b236-ff3e2ccce2f4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.114682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c71a7-8f49-4358-8887-a55bfce38e88 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.134557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.135366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.135658 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.135944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.147849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:29.150981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.151657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.151950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.152234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.153036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:29.153353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.154741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:29.155463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:29.156484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 144/277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:29.157502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.174399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 134/278] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:29.175267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.260919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b45c-17d8-451e-86af-b85ddc3649d6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.273444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.276717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39aa79-2fe5-4fb8-a93b-ca7e0d92b0a4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.294163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.294960 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.295251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.295536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.296755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.298354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.299823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.300274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 145/279] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.301405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.311420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.314316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.314316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.314316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.314316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:29.314316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.315088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601fbc-2cc4-4bc3-bd5a-e960672860ea None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.324290 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 135/280] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.325537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1e0c-100e-4689-8479-9733fa62968c None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.325836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1e0c-100e-4689-8479-9733fa62968c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.326120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e1e0c-100e-4689-8479-9733fa62968c None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.328765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 136/281] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:29.328765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1e0c-100e-4689-8479-9733fa62968c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.407551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63f0e9-03f3-4d01-b0b3-ece0fd2d9fbe None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.432043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e1e0c-100e-4689-8479-9733fa62968c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.442421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.443297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.443588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.443875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] PATH_INFO: `/v3/users/7f937b9047c54c94bffeff020675ea72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.458176 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] RBAC: Authorizing `identity:get_user(user_id=7f937b9047c54c94bffeff020675ea72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.459669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.461560 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 146/282] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/users/7f937b9047c54c94bffeff020675ea72 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.462143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.470176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.470867 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.471185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.471473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.472199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.474374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee5bc7-f3fb-485f-b50d-484f6ec5f452 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.500897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.559013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3899da3-5d89-4325-960e-f6906ba3cc0a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.569962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 137/283] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:29 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:29.571481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.571777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.572061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.590940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:29.592323 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:29.598793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.604370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.604370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.604370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] PATH_INFO: `/v3/users/6afbc22c72c54f9e89c86319f61b2a40` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.604370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] RBAC: Authorizing `identity:get_user(user_id=6afbc22c72c54f9e89c86319f61b2a40)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.604370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.606603 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 147/284] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/users/6afbc22c72c54f9e89c86319f61b2a40 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.607346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.637713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.684518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 138/285] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:29.684518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.749417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff571cc-4043-410b-8cde-9e2904a13f04 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.758663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.790009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.791105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.791669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.792164 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.793421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, user.id=7f937b9047c54c94bffeff020675ea72, scope.system=all) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:29.793809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.795346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.803725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 148/286] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/role_assignments?user.id=7f937b9047c54c94bffeff020675ea72&scope.system=all&role.id=49628c1d18b540caa266f0e12732fa99 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.804695 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.811801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca44e-2546-45ea-be53-547d0422952e None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:29.858359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:29.859264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:29.859551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:29.859836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:29.861184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:29.862689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:29.865541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 139/287] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:29.872864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:29.928517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:29.960082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8dddf-53de-4901-a337-9e21d8dd136a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:30.011239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:30.012744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:30.013464 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:30.014401 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:30.017076 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2056f-55ea-43e4-ba91-e3ddd35509ed None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:30.029227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:30.040557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:30.041617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:30.042590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:30.046006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 149/288] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:30.053119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:30.059837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:30.060908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:30.061302 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:30.061686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/users/6afbc22c72c54f9e89c86319f61b2a40/roles/a5be771f13d341a5b4eee14a62f765db` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:30.298438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, user_id=6afbc22c72c54f9e89c86319f61b2a40, role_id=a5be771f13d341a5b4eee14a62f765db)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:30.298438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:30.298860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:30.298860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aec6be-4aaa-43b6-b85e-a8de846706e5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:30.299191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 140/289] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:45:29 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/users/6afbc22c72c54f9e89c86319f61b2a40/roles/a5be771f13d341a5b4eee14a62f765db => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:30.299372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:30.299372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:30.299372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:30.299372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:30.299995 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:30.299995 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:30.299995 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:30.299995 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 150/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:30.300680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:30.418768 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:30.422506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91ee6d-1b62-49d0-8bbc-2861236db297 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:30.459010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:30.460201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:30.460734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:30.461257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] PATH_INFO: `/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:30.462674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] RBAC: Authorizing `identity:get_user(user_id=ae8c1249d47a4ff4a521a6fa60b355fc)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:30.464310 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:30.466523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 141/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:30 2022] GET /identity/v3/users/ae8c1249d47a4ff4a521a6fa60b355fc => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:30.473234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:30.600918 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:30.610994 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f800d-5e17-48f6-a663-eb4ea7d039e8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:30.652845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:30.653856 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:30.654353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:30.654821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:30.736460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:30.738260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:30.851710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:30.861736 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 151/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:30.867518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:30.998478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097cd3e-0df4-4455-bcb7-dc136b558ebd None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:31.044282 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:31.045176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:31.045459 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:31.045736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:31.046952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:31.048427 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878646f1-42af-41b3-815c-9ae7b87863e3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:31.050307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 142/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:30 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:31.056652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:31.187321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432df6-4ceb-4b06-845e-60bba6899716 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:31.237683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:31.238883 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:31.239169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:31.239446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:31.240291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=ae8c1249d47a4ff4a521a6fa60b355fc) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:31.240630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:31.242089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510226ae-f109-40d5-a7eb-ddf49afc7c59 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:31.253181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 152/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:31 2022] GET /identity/v3/role_assignments?user.id=ae8c1249d47a4ff4a521a6fa60b355fc&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=49628c1d18b540caa266f0e12732fa99 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:32.186813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2e2d-8738-4caa-8ef9-7ec7ba4a69b6 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.187811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2e2d-8738-4caa-8ef9-7ec7ba4a69b6 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.188301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2e2d-8738-4caa-8ef9-7ec7ba4a69b6 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.190143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 143/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:32.195872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.196740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.197240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.214404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:32.215900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:32.273089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.290609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 153/296] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:32.310083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357579-7922-4c3a-a089-997980cee0f6 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.310378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357579-7922-4c3a-a089-997980cee0f6 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.310669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357579-7922-4c3a-a089-997980cee0f6 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.313456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 144/297] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:32.313651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.318084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51294-f360-462f-912e-91557d292c6e None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.318359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51294-f360-462f-912e-91557d292c6e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.318648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c51294-f360-462f-912e-91557d292c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.337325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-c7c51294-f360-462f-912e-91557d292c6e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:32.338561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-c7c51294-f360-462f-912e-91557d292c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:32.371077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.413861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 145/298] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:32.415275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba0afa-bdb5-4553-bcba-474ddbfcd06f None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.415574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba0afa-bdb5-4553-bcba-474ddbfcd06f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.415858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba0afa-bdb5-4553-bcba-474ddbfcd06f None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.420436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 146/299] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:32.422268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.422730 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.423178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.431770 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e672d6-54e3-4e8c-ac50-ecec110f9a3c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.440506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:32.442197 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:32.470943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.471733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.472024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.472330 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.473524 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:32.474990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:32.476794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 154/300] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:32.477392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.516105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 147/301] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:32.517041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.539775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.590947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0bf90-9545-494f-8bba-e89d61dbeff0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.621958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.627860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aebd8d-739e-42b5-80e9-bca69265a192 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.629499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.630307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.630597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.632597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.642946 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:32.650904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:32.651737 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:32.652851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 155/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:32.653439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.670149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.670829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.671119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.671400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] PATH_INFO: `/v3/groups` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.672101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:32.673611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:32.751618 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 148/303] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 22:45:32 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:32.752193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f1773-87ed-40ec-9298-c97de8e02975 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.752352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.768634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.791173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.792015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.792309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.792645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.805289 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-0484df92-2b2c-4633-b9e6-be4aba33e173 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:32.815732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:32.820661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 156/304] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:32.821362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f82-8919-4658-a934-40dec7241d94 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.821981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f82-8919-4658-a934-40dec7241d94 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.821981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db3f82-8919-4658-a934-40dec7241d94 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.822902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 157/305] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:32.823617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3f82-8919-4658-a934-40dec7241d94 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:32.888396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe91b7-a54a-4139-9db0-417fce917c67 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.927709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.928667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.928976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.929263 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.930037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:32.930670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:32.931752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe771b4c-0983-4d3f-8cfa-52e1e3f0625b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:32.941017 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 149/306] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:32.942473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.942767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:32.943053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:32.959949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db3f82-8919-4658-a934-40dec7241d94 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:32.961650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:32.962831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:32.976819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:32.998636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:32.999312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:32.999598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.000620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.000620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:33.000950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.002384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.011194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 158/307] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.011880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.042162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 150/308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:33.042162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.057954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.125680 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562b82-5913-4a1e-8314-6236a523e489 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.149203 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b678a-f21e-4e31-8590-a25ca192970f None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.161766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.162642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.162927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.163206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] PATH_INFO: `/v3/users/7f937b9047c54c94bffeff020675ea72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.164493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] RBAC: Authorizing `identity:get_user(user_id=7f937b9047c54c94bffeff020675ea72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.165930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.167725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 159/309] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/users/7f937b9047c54c94bffeff020675ea72 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.168316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.190342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.191255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.191542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.191820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] PATH_INFO: `/v3/users/0ee2905a22da4a1d806dda398540f60c` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.205210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] RBAC: Authorizing `identity:get_user(user_id=0ee2905a22da4a1d806dda398540f60c)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.207235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.208984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 151/310] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/users/0ee2905a22da4a1d806dda398540f60c => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.210946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.220978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.288780 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e5d7a-f38f-413e-9aaf-8175f1f7880f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.291956 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.317437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eac1e3-5626-4e84-a458-e8cb0419e036 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.325203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.326247 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.327113 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.327599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.342404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:33.351905 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.352800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.353087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:33.353329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:33.354094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:33.354779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:33.355314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] PATH_INFO: `/v3/system/users/7f937b9047c54c94bffeff020675ea72/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.355314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7f937b9047c54c94bffeff020675ea72, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.360523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 160/311] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:33.360636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.360704 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.442955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 22:45:33 2022] PUT /identity/v3/system/users/7f937b9047c54c94bffeff020675ea72/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:33.443838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.467604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2849ecd-bff2-47c8-aa5b-db165a48fe9e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.521554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.522956 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.523590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.524131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.525180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, user.id=0ee2905a22da4a1d806dda398540f60c, scope.system=all) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:33.525942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.528499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.544519 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 161/313] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/role_assignments?user.id=0ee2905a22da4a1d806dda398540f60c&scope.system=all&role.id=a5be771f13d341a5b4eee14a62f765db => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.574043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.601951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b36-41e6-4704-9e58-bf2ffb4fd074 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.641901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.643043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.643350 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.643636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.645034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] RBAC: Adding query filter params (name=reader) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:33.645358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.646838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.657240 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 153/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.663084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.697714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.775222 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694e9af-6c73-41e2-9062-e5023b220253 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.812074 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.812921 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.813204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.813484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] PATH_INFO: `/v3/users/6afbc22c72c54f9e89c86319f61b2a40` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:33.814694 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] RBAC: Authorizing `identity:get_user(user_id=6afbc22c72c54f9e89c86319f61b2a40)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:33.816711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:33.818707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 162/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/users/6afbc22c72c54f9e89c86319f61b2a40 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:33.824425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:33.936274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899f8b5-b635-467e-8c6c-1469c29eaebf None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:33.973004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:33.977400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:33.978070 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:33.978373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:33.978652 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:34.049908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:34.051950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:34.155072 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:34.160634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:34.261707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:34.268123 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069eb0b-ff3e-40d5-91a5-f1fd7a1fd97a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:34.304175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:34.306131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:34.307071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:34.307568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:34.308996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:34.311146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18138bd-ee35-4776-b7d8-a8f45f26cd98 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:34.313394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:34 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:34.321489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:34.353352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:34.425683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039606-3c08-4307-8ae7-e2dc3c7ec4b6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:34.460656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:34.461324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:34.461615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:34.461905 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:34.462753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, scope.project.id=408370c90d4f4be08781b563e2779c0e, user.id=6afbc22c72c54f9e89c86319f61b2a40) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:34.463078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:34.464564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd2bad-b8c6-4411-a795-42c0a652b979 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:34.471005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 155/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:45:34 2022] GET /identity/v3/role_assignments?user.id=6afbc22c72c54f9e89c86319f61b2a40&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=a5be771f13d341a5b4eee14a62f765db => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:34.879978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149be-65c1-42b0-aa63-5eae78e0eb07 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:34.880331 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149be-65c1-42b0-aa63-5eae78e0eb07 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:34.880592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc149be-65c1-42b0-aa63-5eae78e0eb07 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:34.883663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 164/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:34.888436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:34.888436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:34.888436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:34.904859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:34.906058 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:34.973660 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:34.996782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc149be-65c1-42b0-aa63-5eae78e0eb07 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.102386 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc149be-65c1-42b0-aa63-5eae78e0eb07 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:35.136902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:35.137627 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.137915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.138195 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.139451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:35.140939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e5df98-725d-4c1a-9f72-579454030d77 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:35.142728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:35.148378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.176572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:35.250952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45b81-6caf-4c70-a8cb-33f968a323da None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:35.285341 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:35.286024 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.286310 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.286598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] PATH_INFO: `/v3/groups` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.287309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:35.288790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb1bd6-4df4-4a28-9813-8183ad4605af None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:35.379663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 157/322] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 22:45:35 2022] POST /identity/v3/groups => generated 226 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:35.603161 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec68b-4c41-4f99-9431-75462ed66b08 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.603649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec68b-4c41-4f99-9431-75462ed66b08 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.603719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ec68b-4c41-4f99-9431-75462ed66b08 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.605486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 166/323] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:35.611017 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.611570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.612047 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.617073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45060-dcbd-46b1-b7d6-d74702b7dbd5 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.617367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45060-dcbd-46b1-b7d6-d74702b7dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.617652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d45060-dcbd-46b1-b7d6-d74702b7dbd5 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.619023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 167/324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:35.624822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.625336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.625822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.632657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:35.633856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:35.644718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:35.646318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:35.677130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:35.717593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 158/325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:35.729825 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 168/326] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:35.741594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.756194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.765162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:35.882739 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb7d81-5a8a-474b-9f8a-c7c232c93f52 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:35.889881 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa775367-27a5-4e97-8b85-295f54f7ba1c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:35.929794 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:35.930612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.930902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.931183 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.931727 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:35.932560 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:35.932845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:35.933231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:35.943396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:35.951348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:35.952371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:35.953159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 159/327] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:35.953754 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:35.961286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:35.962301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:35.963358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:35.964028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.964106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 169/328] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:35.968202 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:35.999123 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:36.054375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:36.078185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6f601-d729-4507-89c7-32118bd61ea1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.079610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e51097-2500-47c5-8b67-b7ed727a6fd5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.119141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.119752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.119942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.120092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.120594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.120755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.120973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.121248 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.121400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:36.121656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.121999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:36.122306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.123066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.123686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.133936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 170/329] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:36.138638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 160/330] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:36.140487 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:36.143927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:36.239519 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:36.257394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917671bf-fdf4-4e84-bf73-9f4bb06c4af4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.258999 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0094c1-af68-4026-9ff2-caa757afbbf6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.296978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.297285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.297863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.298058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.298206 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.298347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.298486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] PATH_INFO: `/v3/users/7f937b9047c54c94bffeff020675ea72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.298634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] PATH_INFO: `/v3/users/0ee2905a22da4a1d806dda398540f60c` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.299621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] RBAC: Authorizing `identity:get_user(user_id=7f937b9047c54c94bffeff020675ea72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.299838 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] RBAC: Authorizing `identity:get_user(user_id=0ee2905a22da4a1d806dda398540f60c)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.301157 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.301383 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.303375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 171/332] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:36 2022] GET /identity/v3/users/0ee2905a22da4a1d806dda398540f60c => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:36.307945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 161/332] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:36 2022] GET /identity/v3/users/7f937b9047c54c94bffeff020675ea72 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:36.308942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:36.309129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:36.321465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:36.419061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f41ee-b2bb-4a17-b81b-9cf15f1b5003 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.432704 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac635d-f057-41f3-9a8e-3e9ac136efe9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:36.456263 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.457760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.458266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.458836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.459860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] RBAC: Adding query filter params (role.id=49628c1d18b540caa266f0e12732fa99, user.id=7f937b9047c54c94bffeff020675ea72, scope.system=all) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:36.460364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.462014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173417f-4363-4c24-9947-4827d8f30747 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.478150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:36.478437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 162/333] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:45:36 2022] GET /identity/v3/role_assignments?user.id=7f937b9047c54c94bffeff020675ea72&scope.system=all&role.id=49628c1d18b540caa266f0e12732fa99 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:36.479429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:36.479887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:36.480293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] PATH_INFO: `/v3/system/users/0ee2905a22da4a1d806dda398540f60c/roles/a5be771f13d341a5b4eee14a62f765db` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:36.485420 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ee2905a22da4a1d806dda398540f60c, role_id=a5be771f13d341a5b4eee14a62f765db)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:36.487170 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db489caa-143f-4a48-8212-91a9a9c5fc1f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:36.570755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 172/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 22:45:36 2022] PUT /identity/v3/system/users/0ee2905a22da4a1d806dda398540f60c/roles/a5be771f13d341a5b4eee14a62f765db => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:38.333147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cd38-222c-428e-9d0f-2f172fc42dab None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.333674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cd38-222c-428e-9d0f-2f172fc42dab None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.333747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306cd38-222c-428e-9d0f-2f172fc42dab None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.335432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 163/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:38.340582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.340977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.341171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.361635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:38.363400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:38.378781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:38.423551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90dd1a-5f6d-4e75-8351-44fca3c033fe None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.424177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90dd1a-5f6d-4e75-8351-44fca3c033fe None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.425209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90dd1a-5f6d-4e75-8351-44fca3c033fe None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.428922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 164/336] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:38.440050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.440783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.441719 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.467405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 173/337] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:38.477448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:38.478936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:38.554496 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:38.563508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 165/338] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:38.571170 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:38.635217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:38.731276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38c568-c1bc-44bf-ba50-e954558d8cf3 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:38.777029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:38.778124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.778604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.779048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.800820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb21ee2a-40ed-4b88-ab63-e45f24f88abf None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:38.801654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:38.810030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:38.810863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:38.811597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:38.820552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 174/339] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:38.826733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:38.842003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:38.859141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:38.860049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.860341 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.860678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.886992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-012dcdc5-a865-476b-8895-dc4af8b2f63f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:38.895859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:38.896717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:38.897435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:38.903472 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 166/340] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:38.912996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968dbe-d493-47d0-bc6b-26556c0b9a5f None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:38.913293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968dbe-d493-47d0-bc6b-26556c0b9a5f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:38.913576 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968dbe-d493-47d0-bc6b-26556c0b9a5f None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:38.914969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 167/341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:38.917717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968dbe-d493-47d0-bc6b-26556c0b9a5f None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.009470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff565ce1-509d-4f2c-a3c2-3c59bc5d5f60 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.027825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.058830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.059521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.059808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.060093 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.061032 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:39.061349 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:39.062819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab737b-8774-4621-83c9-d8c8649d458b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:39.078854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 175/342] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:39.080275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.080638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.080931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.099700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968dbe-d493-47d0-bc6b-26556c0b9a5f None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.109428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:39.110912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:39.144670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.145129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.145422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.145706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.146542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:39.146789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:39.152425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:39.158089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 168/343] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:39.159036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.273343 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e858c48-b119-4fd7-84ad-f31ae3408004 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.291259 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.297998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.310917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.311588 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.311877 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.312162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.321787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 176/344] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:39.322935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.407656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:39.408818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:39.485962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a52a-1238-435e-8d5b-5f3f02d6e589 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.546322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.547006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.547301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.547587 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.607630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:39.608528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.636462 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.655174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.659365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:39.661607 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:39.732448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7caef-2a4d-4144-852e-d84edaa8bbf3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.769651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.774992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.774992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.774992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.782806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:39.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:39.792909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:39.793636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 170/346] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:39.795026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.830869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 177/347] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:39.831793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:39.894466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.920831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04092-083c-47d8-943c-708ad646f12d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.959872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:39.964885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933affa-defa-4bcc-a323-186e5b940cb2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:39.965011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:39.965975 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:39.966467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:39.966933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:39.968375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:39.970040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:39.972802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 171/348] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:39.973776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.007480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.008154 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.008640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.009055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.009939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] RBAC: Adding query filter params (name=member) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:40.010424 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.011829 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc073f96-dcd8-47c9-9a42-896ad3f41798 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.021209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 178/349] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:40.022313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fd86-ada3-43df-b390-98955e6d1091 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.022723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fd86-ada3-43df-b390-98955e6d1091 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.022889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86fd86-ada3-43df-b390-98955e6d1091 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.024150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 179/350] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:40.025293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83bd4-555f-4857-8722-09f20edce42a None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.025732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83bd4-555f-4857-8722-09f20edce42a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.026153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83bd4-555f-4857-8722-09f20edce42a None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.027807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 180/351] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:40.028707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83bd4-555f-4857-8722-09f20edce42a None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.103294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fef76-bdee-4563-99fd-58366d779ecc None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.148471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83bd4-555f-4857-8722-09f20edce42a None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.149388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.150261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.150722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.151154 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.152351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.154008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d0f57-3269-4241-a4cb-b677ccd4adce None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.156097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 172/352] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:39 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:40.157276 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794805f1-c745-4062-847c-71c622247faa None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.157719 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794805f1-c745-4062-847c-71c622247faa None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.157886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794805f1-c745-4062-847c-71c622247faa None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.159118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 173/353] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:40.162218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794805f1-c745-4062-847c-71c622247faa None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.182922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.188822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.189696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.189980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.190258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.197140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.198792 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1f1be-d67e-4eb7-b11d-c59c57a18fba None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.200671 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 181/354] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:40.201734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d934b16-156c-4f9c-879d-7d34776f5c70 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.202024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d934b16-156c-4f9c-879d-7d34776f5c70 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.202304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d934b16-156c-4f9c-879d-7d34776f5c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.219631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-8d934b16-156c-4f9c-879d-7d34776f5c70 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:40.221113 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-8d934b16-156c-4f9c-879d-7d34776f5c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:40.244387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.286566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794805f1-c745-4062-847c-71c622247faa None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.316889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 182/355] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:40.317373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.317667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.317952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.327508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.328166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.328488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.328773 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.337278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:40.338908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:40.411774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.413288 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445fcfc-56c0-4304-bc55-99b47c1f8028 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.425434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 183/356] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:40.426872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.427769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.529742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 174/357] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:40.529742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.529967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.530508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.533140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.550819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:40.551204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07731637-c8cd-4357-83f0-cf9c6d9aa436 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.558278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:40.592958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.594378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.594378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.594378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.595548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.597180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.598729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 184/358] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:40.599502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.639025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 175/359] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:40.639874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.694690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.715165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9438f38-63b4-4c86-ab8d-0b8ee02c4f88 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.762405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.763205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.763500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.763779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc05f14-0e53-400b-b76d-b84d03065ea0 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.763879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.764677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:40.765007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:40.766475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:40.774639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 185/360] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=e9022c4cbdb242c5a305800f427de25b => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:40.775498 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.806147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.808298 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.809163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.809453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.809736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.823864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:40.831933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:40.832864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:40.834256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 176/361] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:40.834859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:40.929971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da67a9-574e-4ab3-9ea6-fc46f42e40c4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.975806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:40.977244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:40.977549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:40.977864 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:40.982797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472443-00bb-4d58-a4f0-caf6f8837d97 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:40.984595 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:40.998400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:41.005244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:41.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:41.007168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:41.009085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 186/362] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:41.013811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.034387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.035882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.036173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.037139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.039986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.039986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.042728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 177/363] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:40 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.043843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.113762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.141754 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2446e-30f8-4308-b88d-6ca1cb8b44aa None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.177388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930821fa-e69b-4012-a5fd-2fd3ef8bfa39 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.191879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.192605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.192870 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.193148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.194001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:41.194323 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.196365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.207307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 187/364] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=49628c1d18b540caa266f0e12732fa99 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.208168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.222750 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.225942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.226353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.226767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.244715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:41.255872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:41.256842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:41.257587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 178/365] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:41.259689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.305100 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.356540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dade6-f1f2-4f17-af8a-ca3f424a0fe5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.399325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd7f1-ec94-4966-b2e8-4b1149ddc434 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.403796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.404721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.405156 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.405583 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.406508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:41.406975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.409035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.421146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 188/366] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.422351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.426604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.442760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.444006 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.444733 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.445328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.446668 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:41.447043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.448599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.458471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 179/367] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.459462 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.553474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b6cc5-0b05-4e90-8f4a-b54bce7e86f7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.580462 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.590550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937978-6f0a-4340-8e1e-d65852f83a33 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.606329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.609194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.609523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.609818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.611531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.613667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.615831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 189/368] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.616623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.638345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.639385 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.639886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.640362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.641431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:41.641932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.643488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.652924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 180/369] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.653997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.705627 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.749067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd7f9f-a6c5-4717-a21a-27d792c5fa20 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.774947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfaa5d4-2be7-4f45-8aa8-bc485c9a9b00 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.789374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.790262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.790558 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.790846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] PATH_INFO: `/v3/users/0ee2905a22da4a1d806dda398540f60c` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.792105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] RBAC: Authorizing `identity:get_user(user_id=0ee2905a22da4a1d806dda398540f60c)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.793610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.795300 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 190/370] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/users/0ee2905a22da4a1d806dda398540f60c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.796175 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.829092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.830605 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.831518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.832208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.860485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:41.910770 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.914647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.917427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1cb0e-25a3-412a-a072-04240e2709ef None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:41.953719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:41.953912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:41.954137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:41.954387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:41.955237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=408370c90d4f4be08781b563e2779c0e) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:41.955561 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:41.957090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:41.962985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 191/371] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=49628c1d18b540caa266f0e12732fa99 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:41.965047 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:41.967899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.041744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 181/372] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:42.043512 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.108798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.109180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9ae06-7666-4012-8f1d-cdc15bcf569b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.156948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.157637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.157932 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.158218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.173129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4da7-1d0b-42e2-86b8-a6db43c64f45 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.218136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.218818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.219113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.219409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.220264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] RBAC: Adding query filter params (role.id=a5be771f13d341a5b4eee14a62f765db, user.id=0ee2905a22da4a1d806dda398540f60c, scope.system=all) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:42.220617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.222626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.236906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 182/373] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/role_assignments?user.id=0ee2905a22da4a1d806dda398540f60c&scope.system=all&role.id=a5be771f13d341a5b4eee14a62f765db => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:42.237897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.255033 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.259049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.261607 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.358148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2e8d-0b20-4cc2-8e7c-15bd85fe5c30 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.373688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.397813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.398122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 192/374] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:42.401359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.401709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.402006 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.405498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.407010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.409053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 183/375] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:42.410859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.436517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.562695 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fd3b8-96e6-4212-97c6-3558543acbe5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.565049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.609277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7774b14-0c7e-43f8-9b60-08103c4ab495 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.638762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.639656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.639943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.640224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] PATH_INFO: `/v3/projects/c3b61017ad52497f9af5e51cae2447ec` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.645365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] RBAC: Authorizing `identity:get_project(project_id=c3b61017ad52497f9af5e51cae2447ec)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.646859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.649027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 193/376] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/projects/c3b61017ad52497f9af5e51cae2447ec => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:42.656339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.657883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.658782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.659077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.659362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.661925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.663522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.665625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 184/377] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:42.671111 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.745773 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:42.788492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770105d-b621-4298-b0ad-0c68a5884c2d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.807841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797482fe-452e-44fe-9888-3588670ba4cb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:42.841642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.842425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.842715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.843193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] PATH_INFO: `/v3/groups/59eb108c94824f74be5d44216cfb8acf` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.854485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:42.855383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:42.855854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:42.856283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:42.857218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] RBAC: Authorizing `identity:get_group(group_id=59eb108c94824f74be5d44216cfb8acf)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.857511 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=408370c90d4f4be08781b563e2779c0e) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:42.857995 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:42.858708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.859729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f27f-d49d-47ac-aa52-450d77309c7c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:42.860755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 194/378] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/groups/59eb108c94824f74be5d44216cfb8acf => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:42.866448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:42.867230 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 185/379] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:42.919576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:43.000363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6794f86-14f5-431d-8cd6-dd438d744caf None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:43.053025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:43.053701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:43.053992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:43.054277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:43.055129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] RBAC: Adding query filter params (group.id=59eb108c94824f74be5d44216cfb8acf, role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=c3b61017ad52497f9af5e51cae2447ec) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:43.055455 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:43.056966 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cad76-e0e0-4d13-8def-b18f41f46418 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:43.063678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 195/380] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:42 2022] GET /identity/v3/role_assignments?group.id=59eb108c94824f74be5d44216cfb8acf&scope.project.id=c3b61017ad52497f9af5e51cae2447ec&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:43.669517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c78c-799e-4371-8a9a-904da51e02c1 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:43.669517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c78c-799e-4371-8a9a-904da51e02c1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:43.669517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450c78c-799e-4371-8a9a-904da51e02c1 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:43.669517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 186/381] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:43.678171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:43.678596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:43.678781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:43.689037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee96de-9267-4b12-9e64-5b99c692a804 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:43.689037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee96de-9267-4b12-9e64-5b99c692a804 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:43.689037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee96de-9267-4b12-9e64-5b99c692a804 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:43.689037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 187/382] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:43.699513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:43.699513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:43.699513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:43.713819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:43.715013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:43.725798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:43.727264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:43.816430 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 196/383] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:43.832678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:43.858494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 188/384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:43.864853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:43.897993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:43.992856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:44.012183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8036c-4dca-45e2-9dd7-58c531d23991 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.106751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.107957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.108475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.108957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.127665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5557d-8301-4e5d-8181-cc545cd139e4 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.135234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:44.151989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:44.152933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:44.153689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:44.161164 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 197/385] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:44.165742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.216013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.218335 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.223348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.223885 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.240072 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:44.250353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:44.251209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:44.251959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:44.255154 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 189/386] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:44.261857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.353453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:44.366497 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faed2fe-3db2-499a-88ca-94f39d0bd2d9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.414645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.415328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.415615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.415897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.416685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:44.417002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:44.418401 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:44.437856 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 198/387] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:44.441347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.454827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64197456-f1d8-420d-8d49-2dfb217a11ca None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.456930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:44.517717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.518327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.518615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.519438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.520209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:44.520553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:44.521956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:44.536767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 190/388] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:44.542252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.632663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e7535-c59c-4f71-9f89-2eab43f5e6dd None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.700109 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.701169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.701440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.701733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.702927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:44.704447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29315366-1827-4e6a-bd4d-0356bdbe07ef None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:44.706882 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 199/389] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:44.708064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c3a9-52c9-4f17-81fc-761ec156f005 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.708352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c3a9-52c9-4f17-81fc-761ec156f005 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.712536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dc9cd-76f3-4c66-8153-abd047a825c1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.712973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10c3a9-52c9-4f17-81fc-761ec156f005 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.714410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 200/390] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:44.715496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c3a9-52c9-4f17-81fc-761ec156f005 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.737392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:44.761178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.762662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.763128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.763553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.766844 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:44.770430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d7ee2-1fff-4a91-8b55-cebe8a3444f1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:44.772257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 191/391] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:44.773532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872071b-f11a-446e-ba49-14159237c942 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.773827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872071b-f11a-446e-ba49-14159237c942 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.774293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872071b-f11a-446e-ba49-14159237c942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.791432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f872071b-f11a-446e-ba49-14159237c942 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:44.792681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f872071b-f11a-446e-ba49-14159237c942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:44.819113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:44.842357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10c3a9-52c9-4f17-81fc-761ec156f005 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:44.868430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 192/392] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:44.868430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872071b-f11a-446e-ba49-14159237c942 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:44.913395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:44.914259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:44.914542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:44.914815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:44.916015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:44.917499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:44.919627 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 201/393] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:44.920262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.016849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872071b-f11a-446e-ba49-14159237c942 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.018355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.039985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fde5e-b10a-4448-b184-cc4482129350 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.057405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.058289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.058601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.058863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.060066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.061963 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.063764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 193/394] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:45.064708 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.088527 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.090216 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.090971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.091431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.098980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.107201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:45.117433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:45.118350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:45.119118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:45.126796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 202/395] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:45.126796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.191354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1c098-c09a-4cc8-8331-3bc5b579e4a5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.240963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dd24a-7935-45d2-9c98-b42a371e6ae6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.242028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.244080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.244611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.245120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.247866 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.250085 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.276895 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.277783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.278067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.278346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.280307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] RBAC: Authorizing `identity:create_grant(project_id=04b5051f4ed04860acde36f52ed8fb1a, group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.281907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.324471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 194/396] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:45:45 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/e9022c4cbdb242c5a305800f427de25b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:45.325745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.359106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 203/397] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:45:45 2022] PUT /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:45.444534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.455762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccde8d-18b1-4701-a278-addf7f9b26e1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.497206 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.498236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.498702 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.499153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.500096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:45.500604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.502402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631afb1d-7b5b-4c82-bd27-5706e4dd9951 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.512810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 195/398] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:45.520662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.531542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.612499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b56d-74b9-4214-8501-07e2c4aaa504 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.613341 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b56d-74b9-4214-8501-07e2c4aaa504 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.613553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b56d-74b9-4214-8501-07e2c4aaa504 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.619058 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 196/399] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:45.621093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a460-bac4-409e-8cee-babb9be44f9b None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.621392 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a460-bac4-409e-8cee-babb9be44f9b None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.622005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773a460-bac4-409e-8cee-babb9be44f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.640978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-4773a460-bac4-409e-8cee-babb9be44f9b None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:45.644041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-4773a460-bac4-409e-8cee-babb9be44f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:45.646468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fce0a-3864-4484-8619-f63c0829bb1d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.689559 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.690916 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.691225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.691515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.692945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.694405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad257a-b2ea-4d0b-a8e9-daf256761ade None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.700226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 204/400] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:45 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:45.700226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595b9bf-a7fb-488e-8df6-e3b9689e2b6c None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.700226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595b9bf-a7fb-488e-8df6-e3b9689e2b6c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.700226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595b9bf-a7fb-488e-8df6-e3b9689e2b6c None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.701370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 205/401] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:45.705055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595b9bf-a7fb-488e-8df6-e3b9689e2b6c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.732428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 197/402] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:45.732428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.732428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.732428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.756503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:45.758055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:45.807987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.830210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:45.831316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.836926 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595b9bf-a7fb-488e-8df6-e3b9689e2b6c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.846662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:45.879443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.884172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.884698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.885795 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.887380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:45.891669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:45.894931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 206/404] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:45 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:45.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:45.946371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24604f-2818-4a58-ae8a-f30a449dc555 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:45.986346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:45.987278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:45.987608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:45.987899 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:45.999806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:46.010414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:46.011479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 199/405] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:46.017045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.018476 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0e1de-cba4-4768-aa7c-6716e35a54ee None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.057017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.058059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.058496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.059018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.070320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:46.078797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:46.079811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:46.080753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:46.083540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 207/406] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:46.084826 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.088741 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.090289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.122553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96c04-371a-4cc4-b134-440e89cd2132 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.163398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.165340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.165340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.165530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/49628c1d18b540caa266f0e12732fa99` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.168118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role_id=49628c1d18b540caa266f0e12732fa99)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.169685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.198101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1de8c-6c74-4707-8548-5b1d8cfda03d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.234290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.234965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.235252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.235530 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.236334 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:46.236681 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.238060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 208/407] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:46.251566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.287426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 200/408] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:45:46 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/49628c1d18b540caa266f0e12732fa99 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:46.288789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.357705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.424524 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84d4c2-4111-42a6-8012-cd22e3ce0f78 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.438546 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189493-fc56-4131-a5ff-12edf3bf61cc None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.464780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.467854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.469168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.469705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.470184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.471640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.474115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.476610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 201/409] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:46.482958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.549558 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.550289 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.550581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.550913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.551677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:46.552025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.553414 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.563138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 209/410] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:46.569278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.610711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047e1ec-8b62-454c-9f9a-7c0545c1686a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.656888 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.659468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.660756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.662361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.664523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.667500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 202/411] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:46.673382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.694333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9337e9-7b69-454f-8488-25f33acd36ab None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.726852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.738641 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.740061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.741061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.741547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] PATH_INFO: `/v3/groups/59eb108c94824f74be5d44216cfb8acf` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.742980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] RBAC: Authorizing `identity:get_group(group_id=59eb108c94824f74be5d44216cfb8acf)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.744788 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.747525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 210/412] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/groups/59eb108c94824f74be5d44216cfb8acf => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:46.757326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.797617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:46.833488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962aca1-a9a9-4425-a215-966581fb4071 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.878442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.879566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.879993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.880426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.886247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] RBAC: Authorizing `identity:create_grant(project_id=408370c90d4f4be08781b563e2779c0e, group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.887874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeae253-6025-4e3c-9cee-4e9ff4afe669 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.914374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63059c94-efef-43d9-be4e-5cdfca2cf48d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:46.949433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:46.950233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:46.950525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:46.950808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] PATH_INFO: `/v3/projects/c3b61017ad52497f9af5e51cae2447ec` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:46.952005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] RBAC: Authorizing `identity:get_project(project_id=c3b61017ad52497f9af5e51cae2447ec)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:46.953586 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:46.955609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 211/413] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:46 2022] GET /identity/v3/projects/c3b61017ad52497f9af5e51cae2447ec => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:46.965389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:46.986914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 203/414] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:45:46 2022] PUT /identity/v3/projects/408370c90d4f4be08781b563e2779c0e/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72/roles/e9022c4cbdb242c5a305800f427de25b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:47.053192 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:47.103134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e538ee1-5233-4464-aad1-de7d2dc9aaf5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:47.140382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:47.141693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:47.142172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:47.142641 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] PATH_INFO: `/v3/projects/c3b61017ad52497f9af5e51cae2447ec/groups/59eb108c94824f74be5d44216cfb8acf/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:47.145456 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3b61017ad52497f9af5e51cae2447ec, group_id=59eb108c94824f74be5d44216cfb8acf, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:47.147136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f98e265-0061-4ba7-8a47-f1bc4ad9e3a0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:47.228101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 212/415] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 22:45:46 2022] PUT /identity/v3/projects/c3b61017ad52497f9af5e51cae2447ec/groups/59eb108c94824f74be5d44216cfb8acf/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:45:47.712226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413fdf-9c31-47e7-8ffb-4b9c81be9e35 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:47.712625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413fdf-9c31-47e7-8ffb-4b9c81be9e35 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:47.712846 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413fdf-9c31-47e7-8ffb-4b9c81be9e35 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:47.714529 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 204/416] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:47.719985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:47.720258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:47.720576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:47.742667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:47.743888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:47.754661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647298-4ebf-4a55-95ed-2f27f9d53982 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:47.754943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647298-4ebf-4a55-95ed-2f27f9d53982 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:47.755233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e647298-4ebf-4a55-95ed-2f27f9d53982 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:47.756781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 205/417] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:47.761628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:47.761925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:47.762213 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:47.785643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:47.786855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:47.863935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 213/418] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:47.893003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 206/419] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:45:47.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:47.917216 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:47.996562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.016773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.040135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724f292-a030-498d-a970-c42a1b0f2589 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.077859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.084039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.084039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.084039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.096227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:48.104964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:48.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:48.106543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:48.107112 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 207/420] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:48.111985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.131296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29f120-b13d-4861-88ab-31bfc3a712a1 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.212162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.213350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.213949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.214443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.227983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bea4af-e8cc-43d9-a505-2e5fb5dd9d98 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.247057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.249369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:48.265536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:48.266421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:48.267209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:48.267792 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 214/421] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:48.271597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.272280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.272601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.273064 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.273653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:48.273966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:48.275850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.283081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:48.302792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 208/422] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:48.307795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.439423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3673be00-10ac-4281-9b7e-0b1faf9207f5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.477380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.478610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.478904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.479187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.553994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:48.555402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:48.568855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.586294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474cf49-b513-4378-b5b6-42ee23991594 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.626256 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.678169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:45:48.685372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.689648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.690335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.690625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.691440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.692204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:48.692541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:48.693937 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:48.715794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 215/424] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:48.721328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.809775 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:48.832498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf303d-9471-42c3-b4ba-3879e9bf3373 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.873225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.874104 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.874394 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.874675 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.875881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:48.877877 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:48.879988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 210/425] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:48.888164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:48.910385 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9b74a-6985-4ef1-9774-d5d1ba6a157c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:48.945832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:48.946493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:48.946787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:48.947070 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:48.998577 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.030478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.032619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c672b-9b36-453f-8ebb-80bdd133626d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.043340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d3063-49e7-4078-bd55-ac6584408731 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.084450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.086259 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.086695 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.087151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.089245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.091376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8634f-a81a-43c1-bf28-d9bc53fbf753 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.099406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 211/426] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.099406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076c49-a6e6-47be-bf3b-5a25a5f7aec5 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.099625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076c49-a6e6-47be-bf3b-5a25a5f7aec5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.100627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076c49-a6e6-47be-bf3b-5a25a5f7aec5 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.103123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 212/427] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:49.104062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076c49-a6e6-47be-bf3b-5a25a5f7aec5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.128868 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.167286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 216/428] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:49.169236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853620af-6a23-4790-833c-946ad9d5997d None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.169536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853620af-6a23-4790-833c-946ad9d5997d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.169821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853620af-6a23-4790-833c-946ad9d5997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.190645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-853620af-6a23-4790-833c-946ad9d5997d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:49.193062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-853620af-6a23-4790-833c-946ad9d5997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:49.227487 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076c49-a6e6-47be-bf3b-5a25a5f7aec5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.263481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.264149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.264457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.264744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.265575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:49.265910 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.267393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.280651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 213/429] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=49628c1d18b540caa266f0e12732fa99 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.280651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.297199 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 217/430] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:49.351993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853620af-6a23-4790-833c-946ad9d5997d None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.355769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.388068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.414844 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bb3ff-3e02-4389-a268-a54c3bb94631 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.448962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.449862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.450148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.450438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] PATH_INFO: `/v3/projects/04b5051f4ed04860acde36f52ed8fb1a` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.451731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] RBAC: Authorizing `identity:get_project(project_id=04b5051f4ed04860acde36f52ed8fb1a)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.453222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c677a-b7bd-4438-82d4-051655a42907 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.455084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 214/431] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/projects/04b5051f4ed04860acde36f52ed8fb1a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.457217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d95a-27b7-4289-bfca-0d6a34cbe462 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.457506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d95a-27b7-4289-bfca-0d6a34cbe462 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.457789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5d95a-27b7-4289-bfca-0d6a34cbe462 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.459146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 215/432] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:49.464574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d95a-27b7-4289-bfca-0d6a34cbe462 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.503837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853620af-6a23-4790-833c-946ad9d5997d None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.550597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.551421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.551714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.552119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] PATH_INFO: `/v3/roles/member` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.570380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-61a7c61f-d586-4fb9-9331-357cf771d31f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:49.578651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:49.579703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:49.580571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 218/433] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:49.581413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.581981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.582214 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.583243 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5d95a-27b7-4289-bfca-0d6a34cbe462 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.607541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:49.609164 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:49.627854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.629280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.629575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.629966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.631811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.633381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.635382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 216/434] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.635941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.656597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.692529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.705973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 219/435] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:49.707338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.763053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab41bac-cf95-4d40-9c0b-a1bc9eac4d04 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.804187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.804948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.805382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.805805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.806634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] RBAC: Adding query filter params (name=member) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:49.806947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.808782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.818830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 217/436] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.819645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.834466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedd264-25e1-4857-b07b-80fe161a8c68 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.870220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.871075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.871376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.871661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.872541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=04b5051f4ed04860acde36f52ed8fb1a) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:49.872862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:49.874327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a76ef-a447-4f99-aae4-c23f1c2714d6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:49.880668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 220/437] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=04b5051f4ed04860acde36f52ed8fb1a&role.id=e9022c4cbdb242c5a305800f427de25b => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:49.884134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56630-b754-401d-9c9a-989c319e0764 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.884134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56630-b754-401d-9c9a-989c319e0764 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.884134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a56630-b754-401d-9c9a-989c319e0764 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.884134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 221/438] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:49.884948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56630-b754-401d-9c9a-989c319e0764 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:49.906990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.933531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e0e9a-8991-41f7-a3d7-4beda1eb9174 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:49.964865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:49.973900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:49.974731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:49.975018 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:49.975302 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:49.988220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b2d89309-05bf-40a9-a5fa-a3f119f51956 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:49.997088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:49.998201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:49.999119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 218/439] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:49.999990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.000279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.000588 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.017034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a56630-b754-401d-9c9a-989c319e0764 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.021407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:50.022625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:50.055484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.056151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.056520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.056979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.104143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 219/440] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:50.105643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.145282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.146395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.186522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.216212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.227527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248a46c-ea02-42a9-8184-f013536b11fd None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.266567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.267245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.267466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 222/441] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:50.267591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.267809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.268385 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.268631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:50.268974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.270365 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.278576 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 220/442] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:50.279742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.369534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cda3a-bb2e-4612-9ee6-6ac502231d62 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.381235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598656f-57f7-4e05-aad5-6c3becae9eb1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.403150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.403880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.404168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.404486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.408546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.414904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.415375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:50.415800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.416087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.416368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.417581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.422005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.422005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 221/443] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:50.422005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:50.423084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:50.423919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:50.424702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 223/444] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:50.426612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.445542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.524811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f239a-f132-49cc-b304-6781becc51f7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.527265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dfb8a-2fc1-40c1-8084-46a74cf80e4e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.558327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.558993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.559668 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.560183 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.566026 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.566888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.567180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.567467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.568775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.570231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.571892 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 224/445] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:50.572703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.628057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.631448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.632967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.656728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.672194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78188278-98b0-4444-84d8-8a02f5023244 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.708154 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.708849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.709135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.709417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.710163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:50.710474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.711854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.720045 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 225/446] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:50.720671 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.734884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 222/447] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:50.735935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.819800 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f452d0-e6fb-4cd3-9895-cd736bbec80c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.829012 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.833104 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d7bab-c94f-4883-94c4-05bc40d7fc75 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:50.854487 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.855142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.855433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.855719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.856597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=49628c1d18b540caa266f0e12732fa99, scope.project.id=408370c90d4f4be08781b563e2779c0e) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:50.856922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.858348 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.864157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 226/448] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=49628c1d18b540caa266f0e12732fa99 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:50.864971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:50.884562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:50.886168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:50.886288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:50.886724 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:50.887166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:50.966974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:50.968545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:50.977460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4966bb6a-7ded-4956-ab02-b6b8e17bb613 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.023393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.023721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.023978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.024263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] PATH_INFO: `/v3/projects/408370c90d4f4be08781b563e2779c0e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.025977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] RBAC: Authorizing `identity:get_project(project_id=408370c90d4f4be08781b563e2779c0e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.026931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.029060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 227/449] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/projects/408370c90d4f4be08781b563e2779c0e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:51.034082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:51.083778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:51.089668 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 223/450] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:51.095074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:51.130318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:51.155426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbabea-6404-4fad-9876-bf7e5a4065b6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.198048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.198913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.199207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.199487 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] PATH_INFO: `/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.200724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] RBAC: Authorizing `identity:get_group(group_id=0e28b9b6bc634d83a9f75dd3ee6f2d72)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.202160 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.203789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 228/451] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:51 2022] GET /identity/v3/groups/0e28b9b6bc634d83a9f75dd3ee6f2d72 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:51.210282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:51.216575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f11e4-a6f2-4d20-a32f-3f8f9f15b7f6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.252981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.254396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.254686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.254965 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] PATH_INFO: `/v3/projects/c3b61017ad52497f9af5e51cae2447ec` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.256156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] RBAC: Authorizing `identity:get_project(project_id=c3b61017ad52497f9af5e51cae2447ec)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.257717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.259407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 224/452] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:45:51 2022] GET /identity/v3/projects/c3b61017ad52497f9af5e51cae2447ec => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:51.264914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:51.317467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b647e-6873-423d-b21f-fec0c4909ad1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.328171 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:51.350678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.351338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.351623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.351904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.352777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] RBAC: Adding query filter params (group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72, role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=408370c90d4f4be08781b563e2779c0e) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:51.353096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.354534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.360364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 229/453] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:51 2022] GET /identity/v3/role_assignments?group.id=0e28b9b6bc634d83a9f75dd3ee6f2d72&scope.project.id=408370c90d4f4be08781b563e2779c0e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:51.364582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6bf23-ef1e-4809-8f64-eda877bb40ea None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.400998 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.401881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.402170 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.402450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] PATH_INFO: `/v3/groups/59eb108c94824f74be5d44216cfb8acf` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.403691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] RBAC: Authorizing `identity:get_group(group_id=59eb108c94824f74be5d44216cfb8acf)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.405207 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ba0a6-7d7b-4552-8e80-1d09959fb780 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.406952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 225/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 22:45:51 2022] GET /identity/v3/groups/59eb108c94824f74be5d44216cfb8acf => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:51.413263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:51.429872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:51.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f9f18-2bf8-433c-baa9-06a894f76f9f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:51.554697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:51.555345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:51.555635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:51.555911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:51.556775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] RBAC: Adding query filter params (group.id=59eb108c94824f74be5d44216cfb8acf, role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=c3b61017ad52497f9af5e51cae2447ec) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:51.557091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:51.558532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc6ef9-d145-4cf7-bd20-a483227b79d0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:51.564717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 230/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 22:45:51 2022] GET /identity/v3/role_assignments?group.id=59eb108c94824f74be5d44216cfb8acf&scope.project.id=c3b61017ad52497f9af5e51cae2447ec&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:54.122857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe8da-81fd-46a0-a8d9-69144c356544 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.123366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe8da-81fd-46a0-a8d9-69144c356544 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.123475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fe8da-81fd-46a0-a8d9-69144c356544 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.125036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 226/456] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:54.141521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.142011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.142095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.164632 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:54.165863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:54.172446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf2128-a2f9-49ed-bba6-4b3580f55843 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.172755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf2128-a2f9-49ed-bba6-4b3580f55843 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.173045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf2128-a2f9-49ed-bba6-4b3580f55843 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.174696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 227/457] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:54.180715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c00b-ae6b-4eb0-9ca9-e9b6f68e8ec2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.181266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c00b-ae6b-4eb0-9ca9-e9b6f68e8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.181747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c00b-ae6b-4eb0-9ca9-e9b6f68e8ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.208135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0645c00b-ae6b-4eb0-9ca9-e9b6f68e8ec2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:54.209364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0645c00b-ae6b-4eb0-9ca9-e9b6f68e8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:54.248161 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 231/458] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:54.293427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.301904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.339724 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 228/459] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:54.341108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92734bb3-7ac2-4d15-85f3-1a0b9b2622f4 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.341400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92734bb3-7ac2-4d15-85f3-1a0b9b2622f4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.341681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92734bb3-7ac2-4d15-85f3-1a0b9b2622f4 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.349069 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 229/460] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:54.350252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.350543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.350823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.368048 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:54.369248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:54.412759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e36566-8f1e-45f3-959a-d95397fcb54e None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.448519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.457298 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.466392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.466392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.466392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.466669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 230/461] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:54.466669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.473328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.475244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:54.500570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:54.501706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:54.502724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:54.502724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:54.502724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.502724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:54.505226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 232/462] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:54.506748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.566738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cbcc6-8cf9-4932-b3de-b53c38a76628 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.573598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.603358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.604555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.605046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.605522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.616484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.618228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.620431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca582b-f1db-4217-8095-8fb8fd66e1d8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:54.637384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:54.638228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:54.639021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:54.639021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:54.639021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.639021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:54.641376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:54.642362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.664684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.665412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.665696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.666142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.682502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.684148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.694531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:54.707089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:54.708092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:54.709174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:54.709174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:54.709174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:54.709174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:54.710706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 233/464] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:54.711692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.757405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79397321-c6c3-44e8-bfca-935358237f22 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.791679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.792355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.792677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.792955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.793691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:54.794003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.795394 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467873-4856-418c-84b6-eb7b80ccaef4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da7afd-3fc5-4434-a9b2-f7dabfe6751c None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da7afd-3fc5-4434-a9b2-f7dabfe6751c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da7afd-3fc5-4434-a9b2-f7dabfe6751c None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 233/466] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:54.812151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da7afd-3fc5-4434-a9b2-f7dabfe6751c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.835277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c174908-125b-463c-a61a-f4711f3439e3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.848255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.872332 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.873411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.874354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.874777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.875675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:54.876203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.877905 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff8d2f-5fa2-4538-9bf8-e8768b8d13b9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.900878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 234/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:54.900878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.900878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.900878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.915068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:54.916205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:54.927659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da7afd-3fc5-4434-a9b2-f7dabfe6751c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:54.935934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:54.963881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:54.964582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:54.964872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:54.965143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:54.965868 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:54.966182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:54.967533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:54.980436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 234/468] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:54.981313 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:54.997253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 235/469] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:54.997253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.092342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def70d-e053-4cf1-ab13-d40642f51864 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.093157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:55.097353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cedf8-ae4b-452d-8520-441f92ba88d0 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.129837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.130560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.130796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.131077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.131825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.132985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.133259 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:55.133661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.133946 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.134225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.134931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.136361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:55.244864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 235/470] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:55.245593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.278838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:55.300543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 236/471] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:54 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:55.300543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.435170 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1497ff2-ea89-4521-801f-09fb07db2463 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.479272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.479974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.480268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.480598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.481330 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.483735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474438d-e2c5-43ab-aba8-c753fbe47ce1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:55.499052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668f1cb-7120-49c3-9000-1159a8275b6c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.540090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.541005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.541292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.541578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.553853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.555378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:55.573308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:55.574201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:55.575241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:55.575241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:55.575241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:55.575241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:55.575241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 237/472] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:55.580796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.598486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 236/473] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:55 2022] POST /identity/v3/users => generated 248 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:45:55.600158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:55.705533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad736d-29ab-47ee-98e2-0495a11b9054 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.737907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b64e-485f-413f-9e56-acbbab0fb73d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.738215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b64e-485f-413f-9e56-acbbab0fb73d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.738477 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647b64e-485f-413f-9e56-acbbab0fb73d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.740116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 237/474] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:45:55.745944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.746491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.746777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.756111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.756751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.757045 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.757332 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.758081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:55.758399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.759798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:55.774150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 238/475] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:55.779794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.780856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:55.782079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:55.867470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:55.891422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:55.917316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:55.917931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50d5ef-9352-402e-81b8-a51ce8a68586 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:55.928541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:55.960591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:55.961304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:55.961595 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:55.962128 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:55.962850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:55.964781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:56.037097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e088-010a-4319-9423-57dca3a40f01 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:56.052636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:45:55 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:45:56.078783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:56.079569 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:56.079862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:56.080145 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:56.081044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:56.083174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:56.124217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.sql.core [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:45:56.124217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 22:45:56.124217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [parameters: {'id': '71ef79a2287a4b0ea2b11b9f855e465d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 22:45:56.124217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=155870) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result.read() Jun 29 22:45:56.150250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:45:56.151584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application yield resource Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise self.value Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application session.commit() Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:45:56.152495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:45:56.153318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:45:56.154160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result.read() Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:45:56.154956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [parameters: {'id': '71ef79a2287a4b0ea2b11b9f855e465d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:56.155710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 22:45:56.158088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:56.160082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:45:55 2022] POST /identity/v3/roles => generated 144 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:45:56.162929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:56.306539 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039434-667f-49ac-893b-537c2395df55 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:56.332100 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:56.344157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:56.347024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:56.347024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:56.347024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:56.356591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f3650a3c-cbdc-4baa-bce9-4544cf242392 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:56.365589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:56.367636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:56.368723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:45:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:56.372958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:56.458947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:56.490395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfe767-ed17-419a-acb3-7515dacde13f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:56.528933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:56.529622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:56.529914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:56.530200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:56.530963 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:56.531277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:56.532688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf8422-1340-4ef4-bccb-fa5e9b065b23 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:56.541847 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:45:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:57.716958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534435d-b8de-4aab-a390-57593873edb6 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:57.717485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534435d-b8de-4aab-a390-57593873edb6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:57.717790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534435d-b8de-4aab-a390-57593873edb6 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:57.719731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:57.726161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f1c-4bfb-4afe-b0d8-e08d591cb7dd None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:57.726988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f1c-4bfb-4afe-b0d8-e08d591cb7dd None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:57.727470 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4f1c-4bfb-4afe-b0d8-e08d591cb7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:57.745429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-be9a4f1c-4bfb-4afe-b0d8-e08d591cb7dd None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:57.747224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-be9a4f1c-4bfb-4afe-b0d8-e08d591cb7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:57.834779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:57.871615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534435d-b8de-4aab-a390-57593873edb6 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:57.883188 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d1214-b8c0-47ce-a21b-222706325a16 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:57.884019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d1214-b8c0-47ce-a21b-222706325a16 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:57.886229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d1214-b8c0-47ce-a21b-222706325a16 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:57.887851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 242/483] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:57.894994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:57.896441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:57.896441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:57.922478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:57.923671 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:58.039368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534435d-b8de-4aab-a390-57593873edb6 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.049269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.062089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 243/484] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:58.084570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.085551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.085980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.086402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.097774 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:58.105850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:58.106896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.107857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:58.110131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 242/485] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:58.111391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.115640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.199953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.290633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c282ef-262d-45c3-aefd-a9474dad3d9d None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.291031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10076c0a-5c92-472c-a748-3cf6d0e8d132 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.357508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.358725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.360005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.360476 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.361413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.361840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.362791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:58.363214 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.363632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.364078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:58.367519 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08847d06-0b2f-453a-9e98-83db34fd6280 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:58.382955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 243/486] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:45:58.384417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4e57-8ea9-48e2-b1c3-de3c2d399da8 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.384806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4e57-8ea9-48e2-b1c3-de3c2d399da8 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.385002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e4e57-8ea9-48e2-b1c3-de3c2d399da8 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.385603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:58.388508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 244/487] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:58.389256 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4e57-8ea9-48e2-b1c3-de3c2d399da8 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-adad93f8-abf2-4d3d-8506-299243cf177c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:58.394875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:58.395901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.396886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:58.399167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 244/488] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:58.400571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.401060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.401515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.419367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:58.420897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:58.472541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.496612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:58.497701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.507180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e4e57-8ea9-48e2-b1c3-de3c2d399da8 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.518237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.548043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.549857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.550438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.550999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.563633 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:58.566212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:58.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:58.589496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:58.590569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:58.590569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:58.590569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:58.590569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:58.590569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:58.590955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.629701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df1a5b-f770-4a47-8cb2-af9f6f8a1b93 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.673044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.674065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.674545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.675050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.676007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:58.676568 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:58.678149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:58.692159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 246/491] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:58.693301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.711849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b662f75-bd45-4f8d-addc-d2a2e8c6d34e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.744326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.761074 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.762543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.762971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.763359 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.777473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:58.788917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:58.789988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:58.795656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.812932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4abd3-ddc9-4e9e-a77c-8760a35fa1af None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.820184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:58.853460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.855378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.855964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.856497 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.857424 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:58.857952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:58.859613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:58.874172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:58.875620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:58.920869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4b73b-c1b8-436f-9102-965595c3d050 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.959716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:58.960561 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:58.960862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:58.961150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:58.971721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:58.973258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:58.991812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fa6ae-7379-4e6a-b2d2-a276da48b8aa None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:58.992223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:58.993236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 247/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:58.994733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.005255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.033801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.034546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.034843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.035132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.035986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:59.036354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.038198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84958b55-ff7b-49f2-b9f7-d636c655d9d3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.048492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 248/495] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:59.049612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39885-560e-4039-9ffe-1b1c4f2e7de5 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.049909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39885-560e-4039-9ffe-1b1c4f2e7de5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.050728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e39885-560e-4039-9ffe-1b1c4f2e7de5 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.056160 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 249/496] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:59.056843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39885-560e-4039-9ffe-1b1c4f2e7de5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.073315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.103777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ce6a-3b19-479d-b783-c522a7aa2744 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.139608 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.140427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.140724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.141011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] PATH_INFO: `/v3/users/nova` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.150151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7284267b-a47c-44a6-af07-ba8ec972053b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:45:59.165640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:59.166553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:59.167552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:59.168118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.168724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.168724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.180615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e39885-560e-4039-9ffe-1b1c4f2e7de5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.185700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:59.186919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:59.216873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.217664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.217956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.218244 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.218976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:59.219294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.220709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.233704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:59.234550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.261221 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 249/499] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:59.262455 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.273432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.332670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.345871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee2892-51e4-4a70-b1d2-ec0c42d939f9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.374258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204370b-8e00-487f-bd46-a9f983793a1a None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.382025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.382829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.383120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.383405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.393451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.394936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.406656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.407320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.407605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.407885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.408761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:59.409076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.411020 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8796c-0007-46c4-bfa3-e1c87caa4b7e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:45:59.412391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:59.413395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:59.414294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:45:59.414294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:45:59.414294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:45:59.414294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:59.414294 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 251/500] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:59.414564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.449376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:59.450739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847264c-2446-417a-861b-1917eb0fe283 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.451040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847264c-2446-417a-861b-1917eb0fe283 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.451324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847264c-2446-417a-861b-1917eb0fe283 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.452580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 251/502] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:45:59.453275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847264c-2446-417a-861b-1917eb0fe283 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.498047 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.516505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5646-9ed1-4e8f-9c34-dc4b4ef3e600 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.551711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.552540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.552836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.553115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.556355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847264c-2446-417a-861b-1917eb0fe283 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.560149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.561650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.573770 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:45:59.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:59.578236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:45:59.579132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 252/503] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:59.579730 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.594480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.595217 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.595504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.595784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.605879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:45:59.614296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:45:59.615389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:45:59.616370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:45:59.618931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 252/504] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:45:59.619786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.680642 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362e255-515e-4841-a498-6a44421155c6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.714297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.714962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.715255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.715543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.716266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:59.716604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.717989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2e1cc-ab53-418a-b6e3-2269e70cefd6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.720257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771fc29-fcb5-4fe1-b7ef-d18d5ea3a977 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.726579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.730194 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 253/505] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:45:59.731368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.731662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.731946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.748721 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:45:59.750017 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:45:59.759429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.760088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.760464 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.760755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.806233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.817600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 254/506] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:45:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:45:59.818459 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.840760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.842450 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:45:59.922062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d4989-4c3b-43b1-bf1e-e02810f2e158 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:45:59.946708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 253/507] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:45:59.947553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:45:59.954581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:45:59.960950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:45:59.961630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:45:59.961920 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:45:59.962202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:45:59.963048 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:45:59.969245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:45:59.969245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.001955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 255/508] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.002767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.024770 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.046565 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b62167f-9715-40d7-b946-a8781fb2925a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.081048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.081707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.081993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.082363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.083011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:00.083328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.084752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.092591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 254/509] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.093370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.102164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3579ad3-4b56-473b-8e07-0483c6670ddb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.137053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.137858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.138148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.138432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.145698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.147093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:00.161997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:00.162881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:00.163845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 256/510] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:00.164841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.198934 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5fb8-2750-4116-ae8e-737840f7337b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.212489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.232708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.233502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.233787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.234066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.242692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.244910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.246622 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:00.263252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:00.264275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:00.265184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:00.265184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:00.265184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.265184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:00.265396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697563e-4611-474d-ba85-a02c91b32d04 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.265490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 255/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:00.265490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.299816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.300645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.301168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.301278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.311937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.313444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:00.330115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:00.330961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:00.332339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:00.332339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:00.332339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.332339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:00.332339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 257/512] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:00.332913 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.370479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f205d-581f-4084-bbf5-a102b8c031ff None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.405575 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.406163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.406451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.406732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.430927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.433803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1486f9-2417-417f-980b-23a5ef06849a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.466059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.468219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.469051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.469344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.469628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.476111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.477621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.480326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.481819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:00.499735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:00.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:00.501526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:00.501526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:00.501526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.501526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:00.501526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 258/513] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:00.501798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.579486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 256/514] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:00.580328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.609422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136d2e5-4249-459f-926b-b61f32a99f88 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.642685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.643357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.643649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.644560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.645407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:00.645727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.647162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.663887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 259/515] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.664657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.675753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.677275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.685869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3517927-958f-45f1-8903-c019b794f565 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.720249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.721013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.721309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.721590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.722318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:00.722629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.724033 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.735575 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 257/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.737312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.761920 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832470a-c8d7-4811-9bad-d293383475db None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.795052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.795710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.796000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.796278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.797041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:00.797350 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.798731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.809799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 260/517] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.810580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.841442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6353-adfa-48bd-8295-84dbe77e3b7d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.875181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.875841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.876126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.876426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.877149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:00.877460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.878053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.879336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.896018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 258/518] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:00.896605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:00.909429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a247de-5707-4fca-b348-9786d3873930 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:00.913643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:00.943804 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:00.944584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:00.944879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:00.945163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:00.955829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:00.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:00.975790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:00.976704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:00.977566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:00.977566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:00.977566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:00.977566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:00.982449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 261/519] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:00.983230 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.006237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d367bf-1cd0-464b-9f62-5883c14fc02b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.046907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.047562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.047855 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.048145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.082226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6c19-aa24-4793-8c59-340b4169e9eb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.103543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.114848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.115570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.116107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.116107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.116870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.118323 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.125421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.126917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.140847 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.190172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 262/520] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:46:00 2022] POST /identity/v3/users => generated 247 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:01.191938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.230422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 259/521] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:01.231556 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.312114 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a1295-dda2-4e89-be33-31871412c02b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.346758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c4ba4-eb33-491c-a98b-d32608482be6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.350143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.350957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.351246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.351532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.358986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.360342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.364882 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:01.377494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:01.378396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:01.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 263/522] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:01.379716 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.395474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.396671 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.397183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.397785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.406470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.407928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:01.422841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:01.423791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:01.424726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 260/523] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:01.425838 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.426820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.491011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3e091-c759-4795-9054-6a6187fc6b03 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.531270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643174-dd93-44a7-985e-0e531cd3bc28 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.534218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.535279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.535571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.535859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.536714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:01.537035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.538433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.551174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 264/524] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:01.556248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.568162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.569001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.569291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.569590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.581069 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.582628 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:01.600454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:01.601329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 261/525] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:01.606885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.632209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.664446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.668591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79cd57-bcce-42db-b03d-b948dd015f98 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.703991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.704697 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.705128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.705411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.707008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:01.707255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.708891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.714534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f1228-9f08-4d23-bbf5-e870b16de8bd None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.732299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 265/526] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:01.732299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.756556 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.757171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.757463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.757746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.758612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:01.758927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.760422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.782790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 262/527] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:01.782790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.838476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a7c97-8301-493f-bd72-990b61a038fa None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.868439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.875226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.876036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.876326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.876637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.885710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.887261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.889938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceae55c-b08d-45fa-aca1-b48924ada719 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:01.904630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:01.905471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:01.906299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 266/528] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:01.906761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:01.929817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:01.930160 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:01.930828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:01.931112 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:01.931398 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:01.932125 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:01.932801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:01.933845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:01.949967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 263/529] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:01.949967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.021164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6be6e8-aa83-442b-b5a6-a87b98aff7e3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.057171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12dc0e-f6ff-4923-9d33-79dca9deff05 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.060086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.060781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.061069 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.061349 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.062193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:02.062510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.063951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.069409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 267/530] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:02.070178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.119438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.120516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.121224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.121908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.141608 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.185339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.205876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23c764-87de-4376-a03e-9b94cf981aee None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.223075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.224818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.246197 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.247128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.247417 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.247699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.248544 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:02.248860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.250311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.267745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 268/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:02.268662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.361372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 264/532] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:02.362830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.395296 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a2e37-9f68-4792-a8b2-4960a6beceb5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.411233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.442013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.442869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.443162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.443443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.452607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.455139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.473863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e588e9-0396-4c0e-a77c-891f4b2a2891 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:02.474518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:02.475351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:02.476172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 269/533] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:02.477085 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.481092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.517555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.518589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.519107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.519591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.520706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=1d09e711c04142f18a4e260c1cc44953) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:02.521227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.522949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.529620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 265/534] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/role_assignments?user.id=1d09e711c04142f18a4e260c1cc44953&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:02.530664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.631360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c276781-c58d-47c3-9102-5ba064def537 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.696342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.697198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.697492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.697777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.717498 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.719326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.722352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca791b3-4313-443b-af8b-cbb227e3162d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:02.731493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:02.758648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:02.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:02.760811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:02.760811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:02.760811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:02.760811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:02.762693 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 270/535] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:02.767855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.794404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:02.795491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:02.795929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:02.796357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:02.797396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:02.798784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:02.801015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:02.838742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 266/536] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:02.844986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:02.886449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:02.972358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161f22-f8ca-4956-a0a8-91e2d8f6bc14 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.040990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.041673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.041968 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.042255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.043008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:03.043326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:03.044763 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:03.048029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb03b2-b834-4090-8885-a2bb52ef4b02 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.075733 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 271/537] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:03.078177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:03.120110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.120914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.121201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.121735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.122701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=65916dc35ed54d6098bfb47ee20c6595) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:03.123019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:03.124636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:03.138343 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 267/538] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:02 2022] GET /identity/v3/role_assignments?user.id=65916dc35ed54d6098bfb47ee20c6595&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:03.211142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f31c14-dc41-41fd-bd35-b02b6a545fca None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.233521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:03.261778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.262598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.262885 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.263178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.277598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:03.279084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-39f77fd4-0969-4a0f-b09b-be930501d3e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:03.296988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:03.297906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:03.298762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 272/539] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:03.304088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:03.341613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:03.346420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6070be-9005-4904-86dd-f6ddd379fbf1 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.346715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6070be-9005-4904-86dd-f6ddd379fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.347553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6070be-9005-4904-86dd-f6ddd379fbf1 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.349940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 273/540] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:03.356168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.357184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.357184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.378849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:03.380450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:03.438642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4524-f57b-47ae-b6b2-15aee66acfc3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.477116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.477506 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.477804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.478090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.478888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:03.479212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:03.480806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:03.493810 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 268/541] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:03.500053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:03.517587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 274/542] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:46:03.563956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:03.648759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:03.662930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a9e80-e232-4a10-9230-c70ddc204917 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.730167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.730734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.731020 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.731298 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.732133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=f8b1dd859dbb48df97ea0cd5b63d0cd8) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:03.732466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:03.733925 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:03.740555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babe4f-6716-48a5-8c1f-63c44ef949b5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:03.743320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:03.750752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 269/543] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:03 2022] GET /identity/v3/role_assignments?user.id=f8b1dd859dbb48df97ea0cd5b63d0cd8&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:03.803261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:03.804137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:03.804450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:03.804733 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:03.825664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:03.834241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:03.835186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:03.835985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 275/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:03.842189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.016967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375afe4e-b958-458f-a471-ec5792c4df74 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:04.057766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:04.059241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.059733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.060225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.061196 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:04.061777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:04.063438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:04.073688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 270/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:04.081566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.221179 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf94d9-3e8f-4658-a3f4-ce89a0054520 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:04.274131 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:04.275291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.275781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.276269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.293360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:04.295152 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:04.318345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:04.319311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:04.320198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:04.320198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:04.320198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:04.320198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:04.322172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 276/546] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:04.327807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.351672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:04.448119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7bfe6-0e6f-4d51-a092-092881465c5d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:04.488634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:04.489664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.490156 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.490637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.491577 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:04.492091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:04.493705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf2279-9732-485c-93e3-eb3d7a0c487f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:04.511063 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 271/547] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:04.516140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.539253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:04.568766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f477-79ed-4681-812e-09db56b2d2d9 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.569089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f477-79ed-4681-812e-09db56b2d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.569329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f477-79ed-4681-812e-09db56b2d2d9 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.571019 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 272/548] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:04.578870 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.578870 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.578870 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.604474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:04.605729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:04.694977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74984157-0cd2-40ae-b0b8-d1b2e59d06b4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:04.735072 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 273/549] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:46:04.736473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:04.737291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.737673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.737959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] PATH_INFO: `/v3/users/swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.745735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:04.747501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:04.762740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:04.763651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:04.764559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 277/550] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:04.770502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.782328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:04.783182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:04.937372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91046f5b-e391-41df-b84e-a66a56fbc15b None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:04.948752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:04.985730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:04.986699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:04.987258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:04.987870 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:04.989899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:04.991059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:04.993265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe111-59ce-4e95-8ad8-57abe320659b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:04.998886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc80b-adc1-4b9a-b5bc-b81a218552ac None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.028436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 274/551] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:05.028436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6ff5-c768-4d90-b46a-3e3fabe20e7d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.028436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6ff5-c768-4d90-b46a-3e3fabe20e7d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.028436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f6ff5-c768-4d90-b46a-3e3fabe20e7d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.029614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 275/552] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:05.030585 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6ff5-c768-4d90-b46a-3e3fabe20e7d None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.051569 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.052786 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.053286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.053765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.064713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b483d8a6-337a-46f7-bf92-6194d4144c51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:05.078248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:05.079616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:05.080843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:05.084244 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 278/553] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:05.085794 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.086297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.086783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.102551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.105401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:05.106816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:05.144452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f6ff5-c768-4d90-b46a-3e3fabe20e7d None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.178818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 279/554] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:05.180103 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.189506 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.190284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.191094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.191457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.251127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.284884 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.286381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.289112 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd5de7-29e0-418f-9add-76ba2b093aef None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.329079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.330142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.330645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.331128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.332892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:05.333418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.335010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.344040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 280/555] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:05.345233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.355188 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.405387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 276/556] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:05.405387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.454761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00599bc0-da85-4222-b3c1-a658d6594b9d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.482184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.490952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.499948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.499948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.499948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.504615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:05.512484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:05.513586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:05.514500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:05.520212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 281/557] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:05.520212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.525316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab277bc-f5a5-4e64-ac5d-77c3dba24b6e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.566336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.567147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.567437 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.567716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.578077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.579530 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:05.596758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:05.597731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:05.598555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:05.598555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:05.598555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:05.598555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:05.602635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 277/558] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:05.605695 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.624549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.627236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ab82e-196f-4e30-ba2a-ba0d3c1c2f49 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.664105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.664873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.665163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.665446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.676546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.678051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-1329eb0b-12fe-457f-8194-bb7dc421e058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:05.696848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:05.697753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:05.698604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:05.698604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:05.698604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:05.698604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:05.702838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 282/559] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:05.703961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97788-7653-4f0d-a59b-2d2ab8ab2bff None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.704231 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97788-7653-4f0d-a59b-2d2ab8ab2bff None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.704513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c97788-7653-4f0d-a59b-2d2ab8ab2bff None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.706013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 283/560] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:05.706600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97788-7653-4f0d-a59b-2d2ab8ab2bff None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.717897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30710fc9-458e-43df-8810-90f959e3f23c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.751776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.760619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.763389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.763389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.763389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.763389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:05.763389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.764354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.777515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 278/561] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:05.777515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.820033 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c97788-7653-4f0d-a59b-2d2ab8ab2bff None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.856795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.857474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.857760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.858039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.858769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:05.859077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.860466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ce674-6842-48af-a702-861ca82a4f49 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.863760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:05.874550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 284/562] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:05.875887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.878880 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.878880 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.894543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc330c8-9aab-46b0-8455-9d125158a51a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:05.898911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:05.900101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:05.936394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:05.937037 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:05.937417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:05.937710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:05.938443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:05.938760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:05.940282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:05.957621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 279/563] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:05.957621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:05.980429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 285/564] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:05.980429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.010575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.075513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e76c5-1646-4fa3-9800-aaeb23ce18c9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.084487 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac861a-517f-4bf1-a884-af9504b45049 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.113963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.114761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.115043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.115311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.120289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.121109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.121400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.121934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.122864 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.127428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.128953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.130189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.131680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:06.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.147121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.153071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:06.153071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:06.153071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.153071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:06.153300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.154118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:06.155011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 286/565] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.155574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 280/566] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.155654 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.155729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.249650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.256861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8404ac0-1fee-4eac-a931-0bf9c3a8685c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.262163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2b1ff-cd70-4d87-965a-e4cd5afce080 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.290770 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.291568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.291854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.292130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.293986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.294811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.295099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.295381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.302144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.302273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:06.303595 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:06.309673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.310581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:06.311382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 281/567] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.312045 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:06.316959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.317887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:06.318734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 287/568] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.319733 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.364172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.416354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3b7c2-6a04-43e2-a294-7b0f77e560b7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.422151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f580377-7a0b-4f43-ab01-a529a8af857c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.450281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.450938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.451225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.451504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.452221 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:06.452576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.453976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c325161-9753-440d-97ac-2a3e4b3c4516 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.457208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.457890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.458181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.458464 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.459305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:06.459621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.461109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.466035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 282/569] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:06.467337 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203278e-8e6e-42bd-8b30-75af1c7028a7 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.467628 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203278e-8e6e-42bd-8b30-75af1c7028a7 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.467906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203278e-8e6e-42bd-8b30-75af1c7028a7 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.469149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 283/570] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:06.469841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203278e-8e6e-42bd-8b30-75af1c7028a7 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.482864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 288/571] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:06.483876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.494110 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.571833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203278e-8e6e-42bd-8b30-75af1c7028a7 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.582713 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.583419 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077875-7ea5-47b3-9350-132d655d12fe None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.607277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.607951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.608243 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.608576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.609339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:06.609861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.611438 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.617963 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.618732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.619085 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.619451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.619957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 284/572] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:06.620306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:06.620653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.620818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.622339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb59ee-c18a-4962-829b-3b8266e1c44d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.639153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 289/573] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:06.639153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.639153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.639153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.652190 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:06.653403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:06.714341 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.719649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 290/574] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:06.729004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.729137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeccad3-71ab-429e-8390-d6e71298b84c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.767545 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.768343 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.768665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.769581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] PATH_INFO: `/v3/users/glance` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.777045 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.778507 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:06.792678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.793638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 285/575] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.795017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.820962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1542d5-c3ed-499f-91a0-82a9991c5cdc None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.829588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.855677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.856507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.856797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.857079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.867551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.869021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:06.886516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.887428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.888279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:06.888279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:06.888279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.888279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:06.888279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 291/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.888922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.899836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9bfad-9ea5-4162-9279-a663ee8d1537 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:06.935912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:06.936739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:06.937038 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:06.937326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:06.938165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:06.947971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:06.949469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:06.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:06.968350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:06.969232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:06.969232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:06.969232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:06.969232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:06.969232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 286/577] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:06.969501 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:06.993117 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137debf8-0851-489a-832b-7f8c3dcf38dc None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.026824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.027481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.027774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.028055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.028934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=df38e733f1f44f4aacbac0f91e545f0b) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.029253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.030704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.036711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 292/578] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/role_assignments?user.id=df38e733f1f44f4aacbac0f91e545f0b&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.039184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.064813 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.078762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55332b36-de6a-4f2a-a0f7-1171728e1a94 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.117151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.118739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.119204 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.119634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.133517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:07.142522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:07.143731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:07.144805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:07.146975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 287/579] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:07.148003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.161505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f10921-0057-4a1b-b5ca-0ef471f83a2b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.176641 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.198442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.199609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.200057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.200517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.201563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.202039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.203658 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.223755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 293/580] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.225065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.272918 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afab13e-401c-47c2-aee7-90504d2240f0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.308564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.309240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.309532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.309822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.310549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.310865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.312268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.325775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 288/581] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.331145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.335088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.344489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a25812-5095-4344-aaf5-7b7fdf176e8b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.382300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.383054 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.383446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.383829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.384709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.385147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.386631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.400390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 294/582] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.401245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.437489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.440423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b7233-b74c-4ab6-9e17-2f8e1f5a053a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.476991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.477667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.477952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.478259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.478999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.479306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.480711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.495335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 289/583] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.495335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.516210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededb9b-ca54-40c0-a4b6-d41899b7530f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.552613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.553517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.553887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.554236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.562092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.567369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.568941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:07.587402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:07.588500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 295/584] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:07.594115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.605471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11385-dd01-4516-a18c-388fe7e10e6e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.639865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.640645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.640940 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.641230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.648261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.649776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:07.665710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:07.666762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:07.667992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:07.671538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 290/585] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:07.672360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.685662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.703553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77333b58-5d4d-46df-8234-8c4cdff57863 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.740623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.741692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.742193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.742312 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.749806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.751293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:07.765620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:07.766542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:07.767428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 296/586] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:07.768021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.789696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38ddf-b8ce-4231-9ea9-8d9c9935e4a6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.817198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.826515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.827305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.827589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.828252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.839007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.840423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:07.859056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:07.859931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 291/587] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:07.861197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.888886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d062-3c85-41b7-a8e5-0f10b17f0770 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:07.925864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:07.926538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:07.926830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:07.927115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:07.927970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:07.928421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:07.929810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:07.947079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 297/588] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:07.947079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:07.948537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:07.973641 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3000681-2907-4811-8031-6a49578218c2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.007927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.008639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.008941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.009226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.010024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.010345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.011814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.024501 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 292/589] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:08.025312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.056548 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa28fc-0afa-40dc-8348-98db43c96f9e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.072014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.094091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.094787 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.095073 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.095356 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.096195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.096547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.098745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.116109 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 298/590] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:46:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:08.116980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.144832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e643-30ef-4db3-8db3-ccabf0a43b7b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.182874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.183886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.184324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.184794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.185537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.186924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.187389 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.188989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.201582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 293/591] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:08.202614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.233425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a5650-8445-4420-baac-b00627de10d5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.270168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.270970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.271261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.271546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.278677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.280125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:08.294530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:08.295384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:08.296221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 299/592] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:08.296739 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.319491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.323849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057e69e-f9a8-4b2d-a94b-2f1bb66c65d9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.359384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.360311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.360629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.360912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/75e56e8718a744f3859938742628d571` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.375554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=8282dd1579c749378efdccf403a539c4, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.377062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.399732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3286-36c4-496b-b1a5-c5c9c7da355c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.421648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.432684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.433474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.433766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.434045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.444382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.447415 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.448895 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 294/593] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:08 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:08.449885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:08.464387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:08.465473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:08.466352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:08.466352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:08.466352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:08.466352 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:08.470670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 300/594] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:08.472029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.590305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2703228f-9dd2-494f-9a4c-66fbc12547cd None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.598684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0425cce-797a-4c06-993f-2b2b303f5396 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.631128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.631807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.632094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.632372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.633322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.633640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.635202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.648491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.649589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.650066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 301/595] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:08.650200 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.650615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.650853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.659714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.661691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:08.678313 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:08.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:08.680145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 295/596] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:08.680762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.693081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.698713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.768711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b94ab-db1c-4803-b747-de6eb90b5297 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.806191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.807215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.807752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.808261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.809515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.810050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.811700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.813090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558486-ee9b-4191-940a-3b972c2d1381 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.825490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 302/597] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:08.828582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.861060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.862493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.863718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.864004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/1d09e711c04142f18a4e260c1cc44953/roles/75e56e8718a744f3859938742628d571` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.886938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=1d09e711c04142f18a4e260c1cc44953, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.888792 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:08.935209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:08.942414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594bcf-a986-48ac-bcf1-f19867351ec5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:08.972743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 296/598] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:08 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/1d09e711c04142f18a4e260c1cc44953/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:08.974594 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:08.990518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:08.991225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:08.991518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:08.991876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:08.993091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:08.993199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:08.994838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.025086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 303/599] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:09.031079 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.104770 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.161843 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a20fc2-0066-45a2-b9e2-55c98d562c5a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.182067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c715ac-1ada-4a9e-86ff-06383cb504d4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.200304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.201070 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.201360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.201644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.209888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.211542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.228828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-a3f4a6c4-f24c-4579-a0a7-f259a1430feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:09.230080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:09.230904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:09.231728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 297/600] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:09.232899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b43c-36cc-4d69-aaf1-6dd27ed3a752 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.233189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b43c-36cc-4d69-aaf1-6dd27ed3a752 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.233388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.233490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b43c-36cc-4d69-aaf1-6dd27ed3a752 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.233997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.234467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.234977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 298/601] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:09.236776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643b43c-36cc-4d69-aaf1-6dd27ed3a752 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.248674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.250882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-4ca2dfa3-afa8-49d4-b6fe-0d610b18f748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:09.275966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:09.277093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:09.278142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:09.278142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:09.278142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:09.278142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:09.280337 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 304/602] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:09.283007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.283467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.283903 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.291973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.308268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:09.310413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:09.365674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643b43c-36cc-4d69-aaf1-6dd27ed3a752 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.388197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.399975 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 305/603] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:09.401969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.409967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.410819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.411230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.411616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.412745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:09.413093 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.415146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.430984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 299/604] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:09.432273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.528043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304b157-bb33-4dd7-964d-d77a0478abd8 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.554071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbea2b1-9d9f-4304-82fa-468f519afe0c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.577599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.578047 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.578476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.579599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:09.580471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.582559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.584919 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.593020 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.593433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.593779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.602091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 306/605] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:09.602091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.607129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:09.615900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:09.617005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:09.617982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:09.620087 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 300/606] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:09.621021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.665352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.734875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d17d99-c489-4c98-a3ed-a192e258f135 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.741651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b77d1-a8e1-4ac1-81d4-8b5ca90c3e59 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.772477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.773436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.773997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.774338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.782193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.783965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.787704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.788818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.789260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.789692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/65916dc35ed54d6098bfb47ee20c6595/roles/75e56e8718a744f3859938742628d571` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:09.800787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:09.803295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:09.804319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 301/607] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:09.805590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.810210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=65916dc35ed54d6098bfb47ee20c6595, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.812841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.910829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 307/608] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:09 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/65916dc35ed54d6098bfb47ee20c6595/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:09.912610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:09.917012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.918533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dbe1bf-0871-42b3-abd0-e33a230d3ba7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:09.960661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:09.961458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:09.961817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:09.962207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:09.963168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:09.963845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:09.965938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:09.977141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 302/609] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:09.984941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:09.986829 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.112277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f1da0-2a3c-4930-9bca-da801a4ceab1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.129973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eff4f-a1ca-4b67-a98a-3b77977cb8a7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.148423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.149016 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.149307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.149649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.150459 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:10.150779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.152223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.169076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.170472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.170922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.171044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 308/610] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:10.171458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.172277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.184523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.186352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:10.206686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:10.207783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:10.208914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:10.208914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:10.208914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:10.208914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:10.210784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 303/611] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:10.215889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.234367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:10.280674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806a24f-8c19-413e-aef6-d70186603530 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.283133 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:10.316088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.317122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.317483 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.317892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/f8b1dd859dbb48df97ea0cd5b63d0cd8/roles/75e56e8718a744f3859938742628d571` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.334248 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab477-6b0a-46b0-8f50-4caf53d3a4fb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.334649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=f8b1dd859dbb48df97ea0cd5b63d0cd8, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.336195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.372723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.373820 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.374315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.374795 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.375698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:10.376163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.377769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.392377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 304/612] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:10.398606 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.432577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 309/613] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:10 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/f8b1dd859dbb48df97ea0cd5b63d0cd8/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:10.483434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:10.521523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a52b-c38d-4a5a-95aa-09853fde6a58 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.576680 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.577514 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.577805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.578090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] PATH_INFO: `/v3/users/swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.591646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.593230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b936da21-2038-4a9a-9cf4-ca098464bbbb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:10.611515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:10.612990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:10.613929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 305/614] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:10.619094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.734078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40306de-0571-463b-9498-52fe7ca8d972 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.772065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:10.772781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.773082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.773360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.774212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:10.774528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:10.775969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:10.783597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5277-e774-4a16-b362-1735ab1d4f95 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.783888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5277-e774-4a16-b362-1735ab1d4f95 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.784171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5277-e774-4a16-b362-1735ab1d4f95 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.789295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 306/615] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:10.795073 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 310/616] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:10.802242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:10.802242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:10.802242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:10.802476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:10.832806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:10.841692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:10.842963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:10.965793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93beed-35b8-42cb-9018-5f669f44606d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:10.987136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 307/617] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:11.017553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.025731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.026866 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.027369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.027851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.039024 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.040936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:11.065326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:11.066795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:11.067635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:11.067635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:11.067635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:11.067635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:11.075200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 311/618] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:11.085405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.127105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.172899 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.219484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b0ef1-53a6-4fb9-8a4e-586b76edeeae None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.223446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c1a43-e1aa-45c6-894c-e5ae82ac09eb None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.277096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.277907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.278199 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.278481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.290181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:11.300572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.300572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:11.301106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:11.301936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:11.302752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:11.303344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.303344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.303344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:11.303344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.303592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 308/619] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:11.305261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.305643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.325873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:11.333937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.432816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f9169-171f-4575-8ebe-107a74f75f77 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.454232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bf00-327d-4e77-acab-39f3df209129 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.458120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.471417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.473055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.473417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.474018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.475239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:11.475623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.477138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0da8-8635-4d32-88fb-b13efba08e78 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.481856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.495056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.495056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.495056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.495596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:11.496055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.497929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad68c-3f1b-4ff7-93c3-3de6e67e511a None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.498417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad68c-3f1b-4ff7-93c3-3de6e67e511a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.499085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ad68c-3f1b-4ff7-93c3-3de6e67e511a None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.501443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 310/622] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:11.502581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad68c-3f1b-4ff7-93c3-3de6e67e511a None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.504985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.507122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6b799782-eeca-4234-aa4f-d50a8fd1f2e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:11.524504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:11.525391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:11.526295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 313/623] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:11.532300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.533182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.533921 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.553312 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:11.554659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:11.630823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 314/624] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:11.631979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.636899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ad68c-3f1b-4ff7-93c3-3de6e67e511a None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.680860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.682335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.682771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.683637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.698211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.700359 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:11.723623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:11.724715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:11.725743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:11.725743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:11.725743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:11.725743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:11.728588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:11.729585 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.754871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2379b-2284-42fe-be97-ec8b725f37ee None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.772031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.773097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:11.798266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.799600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.800690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.801135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.802531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:11.803016 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:11.804900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:11.820162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:11.821704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.843057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d4ac-317a-4d13-a884-0bfb57f3f7fc None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.887142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.890789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.891135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.891425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:11.903029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:11.918365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:11.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:11.920194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 312/627] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:11.920959 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:11.951882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb431fb-14ba-49f6-adb2-62e9508b6697 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:11.995991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:11.997486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:11.997994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:11.998964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.000181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:12.000747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.003333 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.023783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:12.024688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.036059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.044159 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763a156-57b5-4213-adc3-f3c8029e323c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.061958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.089462 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.090974 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.091635 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.092473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/df38e733f1f44f4aacbac0f91e545f0b/roles/75e56e8718a744f3859938742628d571` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.111981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=df38e733f1f44f4aacbac0f91e545f0b, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.114963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.133897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288d06e-4167-4cd8-97b3-93d335264acd None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.170141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.170821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.171113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.171402 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.172149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:12.172509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.173879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.185062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:12.186165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.200670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 313/630] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:11 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/df38e733f1f44f4aacbac0f91e545f0b/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:12.201764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.324278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.338067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa0217-3b06-4c29-910f-4b4a73369aa4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.345077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9b6df-76ea-429e-a48f-c300bb22ace6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.387717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.388980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.389624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.390300 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.402957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.403167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.403908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.404199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.404507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.405670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.414119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.421851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.423362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:12.428988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:12.429869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:12.430760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:12.430760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:12.430760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:12.430760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:12.433244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 314/631] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:12.439211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-8448b87a-0ed4-474e-ab38-28b331b3cc86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:12.444286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:12.445250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:12.446264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:12.451673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 318/632] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:12.453116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dce7b-98e4-4e36-854b-43be153f5435 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.456650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dce7b-98e4-4e36-854b-43be153f5435 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.456650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dce7b-98e4-4e36-854b-43be153f5435 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.459574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 319/633] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:12.462409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.462409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.462409 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.484088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:12.485718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:12.580577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 320/634] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:12.581811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.586458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5f0d2-f31c-497d-85dd-9034214485bc None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.654708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.655685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.655982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.656262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.657086 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:12.657405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.660010 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.678024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 315/635] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:12.682406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.705574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.721683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b67fde-45d9-4a5a-ab6a-b5381934bd85 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.758252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:12.764717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.765454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.765749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.766040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.767049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:12.767372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.769692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.798749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 321/636] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:12.798749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.810703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b4af-df2a-4037-9b3f-f08c65e8424e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.847350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.848382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.848704 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.848984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.859798 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:12.868220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:12.869481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:12.870329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 316/637] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:12.871012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.925882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56095a-a98b-4ea0-b455-a45345bbd684 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.960833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:12.961634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.961930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.962211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] PATH_INFO: `/v3/users/glance` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.969543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:12.971102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:12.980643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e67e8-1510-4eee-8a2f-3580880d2104 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2a0934ae-1803-46ea-b78b-e4a272b0af9a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:12.986729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:12.987833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 322/638] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84065b83-6b62-4ea1-ae65-e4d39e62db3d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:12.993662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84065b83-6b62-4ea1-ae65-e4d39e62db3d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:12.994336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84065b83-6b62-4ea1-ae65-e4d39e62db3d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:12.994336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 323/639] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:12.994336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84065b83-6b62-4ea1-ae65-e4d39e62db3d None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:12.998011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.007177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.027259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.027926 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.028218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.028548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.105184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84065b83-6b62-4ea1-ae65-e4d39e62db3d None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.107162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.109534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d2b01-a482-4fbe-9d11-590230f36e24 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.141659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.142684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.143147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.143623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.145005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:13.145314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.146695 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.160701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 324/640] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:13.161471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.218665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 317/641] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:13.220222 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.220611 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.220963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.233142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.238404 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:13.239780 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:13.254321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.271995 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020828b3-5b40-47ab-b948-dfa7c34301ca None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.308609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.309490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.309932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.312448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 318/642] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:13.312448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.318728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.319613 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:13.319945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.321432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.339667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 325/643] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:13.340526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.436664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc3640-5e04-44e6-bd84-4ca05f6468b4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.446401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72c622-aeb4-46ba-985f-bcfd86415180 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.471585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.475461 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.476268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.476596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.476881 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.482581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.484178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.484178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.484178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.489041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.490526 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.494994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.496752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.500979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:13.513043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:13.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 319/644] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:13.520105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:13.520530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:13.521425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:13.522256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:13.522256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:13.522256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:13.522256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:13.522256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 326/645] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:13.522535 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.627367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24bf5f-3b31-4e7b-a254-cf6ceb8efa5c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.630225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7924ccb-3d29-4a1c-be03-1671242aeee0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.664560 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.664926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.665352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.665575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.665673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.665858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.665960 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.666142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.678075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:13.685644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:13.686553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:13.687405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:13.692288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 320/646] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:13.693113 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.714454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.737123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.739336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.756826 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.802068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205646f-6256-4341-9ad9-56890d524a3f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.838772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.839572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.839871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.840158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.845241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 327/647] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:13.845375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:13.845375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.845535 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.845616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:13.863137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 321/648] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:13.863137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:13.934471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.959174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f6281-9c63-4b2c-b0df-8f782d2292ef None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.973911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fa668-f131-456c-a5a6-4de04cbe1dbd None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:13.995632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:13.996321 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:13.996599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:13.997135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:13.997860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:13.997992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:13.998166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:13.999539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.011974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 328/649] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.011974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.018257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.018543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.018849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.019129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.019877 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:14.020180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.021593 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.031656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 322/650] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.032791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.128500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929d56f-0e13-45cf-bad5-39e457cf864e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.140883 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b63f90-4d30-4627-860e-ad6a5a4af189 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.164159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.165100 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.165396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.165677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.168578 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.175866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.176690 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.176978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.177264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.178307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.180126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.185075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.190657 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:14.197484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:14.198329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:14.199193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:14.199193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:14.199193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:14.199193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:14.201950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 329/651] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:14.202061 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:14.202901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:14.203976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:14.204520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.204598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 323/652] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:14.204598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.252779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.313489 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaa16b-feaf-4461-b8c5-73145e9fcd96 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.313873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c747712-5d41-47ff-bbbe-c4159bd39f09 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.351762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.353301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.353409 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.353590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.353877 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.354092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.354436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.354670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.361683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.363691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.365886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.367317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:14.378609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:14.379466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 330/653] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:14.385325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:14.385871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:14.386649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:14.387508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:14.387508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:14.387508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:14.387508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:14.390718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 324/654] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:14.391436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.439018 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.490421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecb8fd-05f1-40b0-b84f-eaea0542b73a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.491258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.498072 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab43baf-4733-4dbf-b845-e0f88b1cc6f2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.526331 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.526989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.527285 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.527572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.528301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:14.528648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.530025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.532743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.533409 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.533697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.533978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.535469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:14.535782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.537243 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.542463 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 331/655] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.543261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.559709 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.560590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.646543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0322a-9ec0-4ed9-b9b1-1d72f1358948 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.656563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.660636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08853c-c2ef-4369-a106-cd88f20cbaa2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.681127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.681819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.682113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.682399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.683194 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:14.683512 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.684998 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f42dc-ad8b-4803-872a-727a221563af None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.693091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.693746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.694036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.694311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.695017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:14.695326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.696705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.697155 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 332/657] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.698382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d98bf-d2b8-48cc-b06a-98456a665e1b None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.698680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d98bf-d2b8-48cc-b06a-98456a665e1b None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.698975 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d98bf-d2b8-48cc-b06a-98456a665e1b None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.700223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 333/658] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:14.700951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d98bf-d2b8-48cc-b06a-98456a665e1b None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.709862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 326/659] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:14.710689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.725579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.806960 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d98bf-d2b8-48cc-b06a-98456a665e1b None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.810150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cf2e7-0657-47b3-8e72-0a7da5c99bb0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:14.840911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.841711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.842036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.842316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.844156 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:14.844823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:14.845110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:14.845388 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:14.850005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.851450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:14.865129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:14.866180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:14.867122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 334/660] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:14.867591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:14.896661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.918068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:14.919535 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:14.933311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:14.967946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32ef2-5b6a-4eec-9f49-8aac5899df0c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.002042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.002701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.003001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.003798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.004669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.004990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.006421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25203409-3611-424f-98ea-aa180a6a1364 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.012218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 335/661] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.013569 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.013865 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.014149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.020801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 327/662] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:15.021676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.045150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:15.046514 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:15.129629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 336/663] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:15.130860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.146233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bea7060-e498-42e8-b8ff-0807a65849fe None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.159629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.161242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.185924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.186738 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.187024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.187302 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.196029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.197634 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:15.213848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:15.214787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 22:46:15.215746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:15.216287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 328/664] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:15.217078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.249560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c1ab3-f13d-4a85-85bd-8299121d72c5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.285743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.286452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.286749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.287033 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.287831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.288146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.289622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.301810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 337/665] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.302611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.330865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421aef0-c97a-445d-863a-49658d86bbf5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.369859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.370659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.370946 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.371230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.383281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.384732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.393616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:15.402860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:15.407158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:15.408209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.416954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa70db-e328-4fcc-9f87-1535d64353e2 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.432720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.454932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.455737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.456021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.456314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.467604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:15.475221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:15.476139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:15.476967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 338/667] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:15.477982 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.516596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f34913-795c-4ed2-af93-247dacb53f79 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.551759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.552471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.552768 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.553056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.553919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.554241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.555687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.578012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 330/668] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.578012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.589211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8fc9fc-96dc-4538-bab1-0c71661379d8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.624799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.625831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.626262 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.626543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.627395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=1d09e711c04142f18a4e260c1cc44953) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.627702 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.629191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.635329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 339/669] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/role_assignments?user.id=1d09e711c04142f18a4e260c1cc44953&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.635853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.645078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.682267 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.707379 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003838e5-6f5a-415e-b2b4-26f9277e001c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.757064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.758012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.759013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.759463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.760429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.761176 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.763375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.773672 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d8cf4-09cc-4395-b68e-0d083190716b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.785786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 331/670] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.787022 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.826660 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.827705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.828173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.828645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.830378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:15.830707 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:15.832137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:15.841811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 340/671] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:15.843502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:15.933440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593dfd7-5079-4fd4-b3ed-83b0fba8a2a3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.934251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:15.974616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2cb3-5276-4fac-b23b-e38e373c2d0e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:15.974910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:15.975320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:15.975606 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:15.975889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:15.990853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.019495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.020685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.021123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.021553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.030619 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.033063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:16.052725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:16.053869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:16.054944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:16.057843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 341/672] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:16.058823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.064818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.066447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.187532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bfa0-f3dd-440e-bedc-bca531b5d06f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.201892 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 332/673] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:16.203682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.218435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.227752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.230698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.230698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.230698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.242855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.244933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.264885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:16.265954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:16.266784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:16.267635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:16.267635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:16.267635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:16.267635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:16.267635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 342/674] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:16.268344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.346009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ff752-0516-4688-9f03-ecbd6b570949 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.387818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d5566-3828-459e-802c-298704344b20 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.394828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.396308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.396852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.397825 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.399253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:16.399926 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.401948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.419765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 333/675] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:16.421160 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.424358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.425367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.425732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.426780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.438049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.439602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:16.458932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:16.460042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:16.461120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:16.461120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:16.461120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:16.461120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:16.462736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 343/676] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:16.463606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.497345 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.558751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cbca-84a6-4f9a-995f-983020da63c1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.560930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.575821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0548-3067-4753-8006-d9f0b9c30977 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.607276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.608777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.609503 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.609957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.611140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:16.612016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.613997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.616748 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.617562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.617906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.618303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.619254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=65916dc35ed54d6098bfb47ee20c6595) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:16.619679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.621237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.628997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 344/677] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/role_assignments?user.id=65916dc35ed54d6098bfb47ee20c6595&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:16.629902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.630384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 334/678] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:16.645516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.743313 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:16.751068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c4434-8347-429b-98ac-e6a492a78d37 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.795158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.796282 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.796806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.797324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.802644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:16.802644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.802644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.814426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 345/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:16.825820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.836227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83745b-67e4-4129-af6a-f3abf448764a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.895944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:16.897303 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:16.897706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:16.898338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] PATH_INFO: `/v3/users/swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:16.911488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:16.913574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:16.934938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:16.936089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:16.937276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:16.943676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 335/680] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:16.945356 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:16.969502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279155d1-e1f9-41a9-ab57-f41f08080f26 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:16.972896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.006918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.007809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.008175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.008597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.016798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.018390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:17.035704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:17.036822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:17.037710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:17.038416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 346/681] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:17.044226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.058535 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de048-13cc-4146-8297-2437f90bf266 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.063791 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.098106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.099049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.099479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.099895 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.100963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:17.101442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.103029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.124533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 336/682] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:17.127383 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.156140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d386a-227e-41f6-9e0c-c15116aa6e89 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.193650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.194491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.194884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.195275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.196225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:17.196705 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.198811 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.212442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 347/683] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:17.217342 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.219107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.234762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5361624-3193-418f-8a50-74d45da9e1d3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.271295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.272215 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.272724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.273146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.302517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.335274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee9323-12db-43d7-bac1-f86f7107df60 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.344433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.346190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.395600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.396465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.396881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.397269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.398330 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=f8b1dd859dbb48df97ea0cd5b63d0cd8) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:17.398765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.400455 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e18ff-f948-4ad7-9b9b-44dd454809af None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.409149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 348/684] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/role_assignments?user.id=f8b1dd859dbb48df97ea0cd5b63d0cd8&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:17.413706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc768-a6bb-45d2-a3dd-3bdedefca090 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.414172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc768-a6bb-45d2-a3dd-3bdedefca090 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.414578 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dc768-a6bb-45d2-a3dd-3bdedefca090 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.416501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 349/685] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:17.426034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.427040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.427324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.458371 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.471975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 337/686] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:46:17.480742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:17.480742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:17.483422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.602084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c9cd-f49a-4c2d-9827-8fdf8339b37f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.645034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.646572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.647047 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.647525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.664392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.665902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.672962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 350/687] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:17.690249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:17.691787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:17.692678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:17.692678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:17.692678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:17.692678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:17.695036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 338/688] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:17.699366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.700543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.740851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.774989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:17.808269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c232646-b93c-4ede-a417-23a641f10ef9 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.832863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfa150-4a18-4de3-ad80-2edebe544f0e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:17.856191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.857353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.857824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.858380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.876290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:17.877060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:17.877421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:17.877773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:17.878782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:17.879173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:17.880326 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:17.880717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:17.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:17.893771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:17.900674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:17.901805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 339/689] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:17.901805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:17.904036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 351/690] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:17.912941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.069352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.079051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e407-c3ca-4241-bd1f-a5edd07f811c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.089853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5bfa4-da4b-4a17-a77b-e3154dd27c90 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.116776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.118060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.118530 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.118996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.120481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.126332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e952b-6622-475c-a018-823554c028bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.127019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e952b-6622-475c-a018-823554c028bf None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.127313 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e952b-6622-475c-a018-823554c028bf None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.127602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e952b-6622-475c-a018-823554c028bf None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.128980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e952b-6622-475c-a018-823554c028bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:18.129373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e952b-6622-475c-a018-823554c028bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.137339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.137469 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e952b-6622-475c-a018-823554c028bf None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.137545 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.140483 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 352/691] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:18.141817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc7c-847a-4a68-8599-9fbf3258fe2f None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.142116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc7c-847a-4a68-8599-9fbf3258fe2f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.142403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc7c-847a-4a68-8599-9fbf3258fe2f None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-76ddba33-546f-41b8-ac5a-5b75c1d8c51e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:18.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:18.148687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:18.149549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:18.149979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 353/692] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:18.149979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fc7c-847a-4a68-8599-9fbf3258fe2f None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.152312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 340/693] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:18.157994 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.158503 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.158964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.178338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:18.179893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:18.261256 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 341/694] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:18.262257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.275752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fc7c-847a-4a68-8599-9fbf3258fe2f None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.319612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.320567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.320859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.321141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.332635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.334146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:18.353908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:18.354793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:18.355638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:18.355638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:18.355638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:18.355638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:18.355638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 354/695] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:18.356880 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.369844 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.390259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852b239-6982-403e-a59f-8ba08ee44546 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.406495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.427875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.428950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.429415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.429854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.434717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:18.434717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.434717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.446210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 342/696] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:18.447362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.466373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19424-dbe3-4481-ab8f-3f061172f27e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.503935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.504784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.505078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.505363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.516883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.518332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:18.537777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:18.538632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:18.539466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:18.539466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:18.539466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:18.539466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:18.543919 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 355/697] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:18.544793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.560284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507fba3a-df99-442f-9cc5-48e2da872f46 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.597355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.598259 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.598793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.599348 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.600239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:18.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.602408 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.616781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 343/698] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:18.617993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.620986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.649022 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.655657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae20533-d19a-444f-a826-eae9fcf8e1cb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.695579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.696916 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.697391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.697853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.698890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=df38e733f1f44f4aacbac0f91e545f0b) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:18.699390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.701717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.711067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 356/699] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/role_assignments?user.id=df38e733f1f44f4aacbac0f91e545f0b&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:18.712677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.737047 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65705ed1-b560-4f7b-9a2a-719ec6e98eee None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.799167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.800861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.800861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.801417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.802234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:18.802610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.804162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.820366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 344/700] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:18.828301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:18.870662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5827-58a0-4682-87fb-c1184b7d4fef None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.935023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:18.944853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:18.946714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:18.947254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:18.947738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:18.959862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:18.962039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:18.982421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:18.983465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:18.984357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:18.984908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d910e6f-d09e-4548-9bee-b693e611c1d5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:18.987098 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 357/701] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:18.992304 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.022699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:19.031775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.035761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.035761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.035761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.035761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.037263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.109996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c43122-2e07-4472-9aa9-7851cba067d9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:19.139050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 345/702] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:46:18 2022] POST /identity/v3/users => generated 254 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:19.156486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.157286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.157573 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.157968 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.158860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:19.159177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.161517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973685dd-87d4-4111-b047-c864e2909f38 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.186235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 358/703] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:46:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:19.191300 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.309787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4acfc-5a7c-41bf-907a-f03a120f8296 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:19.327254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aba49-8831-4782-b9ba-c42b7345d252 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.327836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aba49-8831-4782-b9ba-c42b7345d252 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.328290 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5aba49-8831-4782-b9ba-c42b7345d252 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.330203 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 359/704] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:19.335433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:19.341930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.342229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.342578 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.362565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:19.363538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.364698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:19.364833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.365003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.365291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.443960 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.444261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 360/705] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:46:19.445429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.471011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.481677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:19.586960 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ffb25-b6ab-45e5-8348-28c21e155933 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:19.588291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 346/706] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 22:46:19.594066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.618130 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:19.634547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.635534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.635976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.636309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.637224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.638669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:19.657907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:19.659080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:19.660122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:19.662388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 361/707] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:19.668227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.728984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee461d-0654-4cbc-bc41-bad48ec388f0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:19.751483 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:19.784427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.784427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.784427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.784427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.803442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.809725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.811471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458a85-a17f-44a0-9a1a-29c15a26f5f7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:19.839969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:19.840909 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:19.842194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:19.842194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:19.842194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:19.842194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:19.842194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 347/708] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:19.847247 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.900897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:19.901891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:19.901891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:19.902189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:19.903220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:19.903532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:19.904955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:19.920844 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 362/709] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:19.921774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:19.964359 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.004943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2ca9-5832-403d-b627-cdf3a8ed025f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.041867 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.043153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.043460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.043749 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.044505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:20.044822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.046277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee94fa0-862b-434f-96d6-d18e66c2d1ae None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.060014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 348/710] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:20.065566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c45-a0d3-4715-a3a1-9637eab52c1a None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.066364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c45-a0d3-4715-a3a1-9637eab52c1a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.066654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08c45-a0d3-4715-a3a1-9637eab52c1a None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.068330 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 349/711] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:20.074011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.074557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.074859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.081841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bde8e9-d828-4b68-a82c-45128c86c3ec None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.095871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:20.098111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:20.119998 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.120955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.121327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.121780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.122829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:20.123145 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.124691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.128308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.136564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 363/712] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:20.147932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.183309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 350/713] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:46:20.210585 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.285278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.343092 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaee850-8015-494d-99e2-a7b4b83949c0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.386388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.387211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.387503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.387784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.390593 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21950706-ba89-44d3-8c41-83e987bc504b None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.395139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.396626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:20.412198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:20.413158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:20.414027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:20.415519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 364/714] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:20.421094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.481703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.482522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.482816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.483100 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.483793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.485187 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.488991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:20.522851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:20.523873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:20.524721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 351/715] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/services/network => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:20.532324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.549359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba049e42-bfaf-4922-bea5-c70c1cfd1331 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.603638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.604395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.604713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.605069 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.605927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:20.606246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.607689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.622825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 365/716] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:20.633488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.690617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98be2d1-b206-4184-9961-c7aa5311d2c8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.715106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.737157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.737928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.738753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.738753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.739231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] RBAC: Adding query filter params (name=network) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:20.739547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.740991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.754851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 352/717] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:20.760370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:20.783057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13201f4-d361-4a39-a3dc-62d9e88abb31 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.806570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:20.828148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.829014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.832439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.836268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:20.836268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:20.836268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:20.837041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36343a46-e095-4469-b854-dbb8c54ac323 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:20.844216 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 366/718] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:20.944356 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3afd-865e-4cec-b396-d8e765930678 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:20.998129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:20.998893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:20.999181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:20.999465 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:21.000245 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] RBAC: Adding query filter params (type=network) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:21.000592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:21.002015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6c5b0-2aa5-4fe0-97be-a1d2afcfceaf None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:21.013612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 353/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:21.371808 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8519f9-aa26-4def-b4e2-6bed3849d067 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:21.372448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8519f9-aa26-4def-b4e2-6bed3849d067 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:21.372673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8519f9-aa26-4def-b4e2-6bed3849d067 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:21.374366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 367/720] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:21.380267 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:21.380597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:21.380888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:21.404274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:21.405537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:21.479501 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:21.505129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 354/721] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 22:46:21.556029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8519f9-aa26-4def-b4e2-6bed3849d067 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:21.706181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8519f9-aa26-4def-b4e2-6bed3849d067 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:21.750007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:21.750823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:21.751121 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:21.751404 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:21.766779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:21.774397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:21.775271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:21.776661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 368/722] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:21.785981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.002522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35094a-1f34-4c03-b005-d8fd403727c1 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.058242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.058928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.059218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.059504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.060264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:22.060619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.062024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99121f2-8fbe-45af-b881-7f56694ab837 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:22.076042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 355/723] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:22.081783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.123809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910092f-595d-4da4-b415-2fe25b748584 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.124146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910092f-595d-4da4-b415-2fe25b748584 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.124393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910092f-595d-4da4-b415-2fe25b748584 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.126681 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 356/724] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:22.132575 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.132872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.133160 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.150715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.153897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:22.155319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:22.213444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.235824 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 357/725] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:22.261030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.275256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4269-dcb0-4794-8a2a-f6e31357692a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.340941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.341749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.342039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.342324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.360240 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.361726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:22.380879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:22.381774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:22.382624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:22.382624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:22.382624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:22.382624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:22.384212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 369/726] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:22.388184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.483244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b91f1e-a40e-446e-87cf-a1ba122ef059 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.498122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.505220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aafe5d-cc0c-4a35-ab62-b9ccd3b42e84 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.544322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.545098 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.545388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.545671 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.546676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:22.546990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.548374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:22.562228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 370/727] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:22.568185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.585111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.585943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.586232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.586514 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.597730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7b3d9022-e72a-46fe-b43e-8d5e66351c24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:22.605714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:22.606655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:22.607478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 358/728] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:22.613264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d049-d692-4de9-997f-d38f3ec552bc None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.613595 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d049-d692-4de9-997f-d38f3ec552bc None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.613888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d049-d692-4de9-997f-d38f3ec552bc None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.615581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 359/729] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:22.616344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d049-d692-4de9-997f-d38f3ec552bc None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.654756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.679575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b52f52-c2d0-48de-8714-5bab5e90859d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.717746 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.718566 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.718861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.719149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] PATH_INFO: `/v3/users/swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.728262 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.729505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d049-d692-4de9-997f-d38f3ec552bc None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.729882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-a8e6b024-b684-4488-8c94-10016cfd4b9a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:22.746384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:22.747614 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:22.748550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:22.753900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 371/730] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:22.754526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.754826 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.755108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.773172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:22.774476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:22.777745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.778669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.779220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.779729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.780773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:22.781292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.783053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:22.786443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.794193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 360/731] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:22.801799 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.853129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 372/732] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:22.853129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:22.929448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:22.936079 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959896-ed0d-426c-8788-d563f599bafe None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.968962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09e719-a897-4a97-a2d0-f63be6e9f79d None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:22.976027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:22.977536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:22.978060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:22.978573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:22.980076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:22.981034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:22.983253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.006479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.007300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.007593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.007878 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.013366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 361/733] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:23.013366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.025064 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.026538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.035338 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:23.047099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:23.051175 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 373/734] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:23.052107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.145225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df7491-7389-4271-b8f7-8429f0428fdf None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.188441 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.189257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.189550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.189832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.190702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.192168 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.294215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d2175-eb3f-4a4c-98fd-35007e50ba4d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.306550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 362/735] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:23 2022] POST /identity/v3/services => generated 251 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:23.307431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.329520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.353762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.354785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.355282 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.355760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.439736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.448688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.450275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd51bf-ecb1-48e9-b2ea-2e2a62b2c506 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.451906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ae4d-3b7c-4bb7-ac22-4b31ded90643 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.497694 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.498374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.498669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.498953 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.499750 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:23.500075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.501516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1099726-c6e0-4a72-9c62-d9ccf1d1064e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.515463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 363/736] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:23.518357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5ec-8641-431b-88cb-eb81c6912b7f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.519191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5ec-8641-431b-88cb-eb81c6912b7f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.519475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5ec-8641-431b-88cb-eb81c6912b7f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.521080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 364/737] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:23.521837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c5ec-8641-431b-88cb-eb81c6912b7f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.575896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 374/738] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:23.582633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.582923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.583202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.603911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:23.606195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:23.620163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.649065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c5ec-8641-431b-88cb-eb81c6912b7f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.684549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 375/739] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:23.684549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.696011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.705324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.705615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.705900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.716788 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.720265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.722495 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:23.742978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:23.743943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:23.744917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:23.748474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 365/740] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:23.750308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.797693 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b9bad-6d63-41fa-a625-2c4fc972c5e2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.839918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:23.839918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:23.839918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:23.839918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:23.853363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:23.855014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:23.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:23.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:23.877205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:23.877205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:23.877205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:23.877205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:23.884192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 376/741] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:23.884192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:23.972454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:23.975997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f614c-9c74-49ce-a169-82e5de8507c1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:23.998293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832512c-2d88-4e2f-96fd-d3ca4067093c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.010851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.011654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.011944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.012223 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.014440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.024051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ade14363-c66b-412c-abbf-69732cbe8b05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:24.031542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:24.032688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:24.034142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 366/742] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:24.035027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6cc5-31bd-4225-b65e-ea4985401938 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.035027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6cc5-31bd-4225-b65e-ea4985401938 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.035027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6cc5-31bd-4225-b65e-ea4985401938 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.036593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.037340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.037974 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.038329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.039250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:24.039642 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.040351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 367/743] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:24.041172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c6cc5-31bd-4225-b65e-ea4985401938 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.041353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.064989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 377/744] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:24.064989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.158692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c6cc5-31bd-4225-b65e-ea4985401938 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.160936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21771e79-ae8b-44df-8f3c-e93068810827 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.194469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.194703 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.195283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.195417 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.195602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.195740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.195875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.196129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.196649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:24.196962 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.197134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:24.197513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.198322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758028-d3d6-4312-8740-f9f6c8fe43d5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.198968 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.199650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.211977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 378/745] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:24.211977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.211977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.211977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.221843 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 368/746] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:24.221843 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.225347 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:24.226526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:24.281310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.296015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 379/747] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 22:46:24.297137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.334386 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f9ec8-a6dd-4129-a7b9-922ec321a6aa None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.371066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.371816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.372108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.372674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.413909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56af2a-b817-445e-bff6-5c832aa96bb4 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.441435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.445563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.447017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.450592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.451401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.451689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.457891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.462521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.463971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:24.481525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:24.482456 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:24.483324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:24.483324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:24.483324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:24.483324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:24.491929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 380/748] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:24.492828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.510009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.559127 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 369/749] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 22:46:24.559957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.608858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dffb8-115e-4cb9-88f1-84de45c69b9a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.645127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.646606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.646964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.647251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.654750 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.656189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:24.670527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:24.671376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:24.672317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:24.672780 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bbad4-c9d3-44e4-bbc2-4c41197e9ec8 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.672855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 381/750] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:24.672855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.709899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.710568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.710849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.711126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.711840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.713306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.719444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.777133 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585fa66-5874-4833-822f-505ce66512eb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.810722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:24.811528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:24.811818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:24.812096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:24.812969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:24.813242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:24.814623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:24.816229 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 370/751] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:24 2022] POST /identity/v3/services => generated 240 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:24.822210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.829412 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 382/752] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:24.830101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:24.845812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.977322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:24.982156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bea864-e059-40ed-83a4-4bda69d86d1c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:24.995718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31049d-4a01-4999-9b6b-888f293577f3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.021965 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.023493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.023493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.023493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:25.024970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.026488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.039413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.040018 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 383/753] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:25.040292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.040616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.040896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.040992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.052790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.054242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:25.071588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:25.072563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:25.073427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:25.073427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:25.073427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:25.073427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:25.073427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 371/754] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:25.074134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.156264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.178136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081ab6b-e0ed-4888-8910-012a41e7332f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.198531 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47454-085e-4566-9203-9d1be0748485 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.227008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.228037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.228366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.228771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.236836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.238428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.244303 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.245475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.245915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.246344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.247592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=df38e733f1f44f4aacbac0f91e545f0b) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:25.248083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.249710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:25.253747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:25.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:25.255964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:25.257945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 384/755] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:25.258893 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.264800 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 372/756] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/role_assignments?user.id=df38e733f1f44f4aacbac0f91e545f0b&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:25.266236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.298761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.421337 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123b03-4711-4004-badd-94df88cdec32 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.464612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.465779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.466161 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.466536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.467373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:25.469113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.469683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cdeb-df3a-46ff-aa70-ccdf41273ed3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.485979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 385/757] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:25.487355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777733-7272-44e3-90cb-621d70de9098 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.487661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777733-7272-44e3-90cb-621d70de9098 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.487947 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d777733-7272-44e3-90cb-621d70de9098 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.489446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 386/758] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:25.494910 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.495036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.495280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.498638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cb1a-1a1e-4e56-b60b-98f6f4cb9954 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.513049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:25.514250 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:25.528446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.538089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.538882 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.540346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.540346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.540630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:25.541052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.542840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.562233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 373/759] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:25.568100 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.604799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 387/760] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:25.607022 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.625845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.694251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380edcf-75a6-4c7d-8927-51ab55439757 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.733067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.734147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.734630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.735016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.743312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.744874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.746101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd00059-63b6-4b65-a164-8fd7e6b764c2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:25.760319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:25.761309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:25.762162 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:25.763468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.795123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.799432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.799432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.799432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.811631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.813716 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.820035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:25.839907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:25.840830 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:25.841691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:25.841691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:25.841691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:25.841691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:25.841691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 388/762] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:25.842649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:25.899027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e0957-a56f-4ccd-9d14-c1b56a59808c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.917390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:25.945484 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:25.946666 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:25.947022 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:25.947380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:25.948290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:25.950125 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:25.964599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:25.966499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:25.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:25.970273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 375/763] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:25.970399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac5c6-d9a2-4f7e-9f93-528c05abb6b3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:25.971400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.021204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.021735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.022031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.022317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.023296 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.023855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.025193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.039141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.039980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.090034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c523f51-dc39-4dea-a25f-d4f2840c2c4e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.100771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.126883 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.131354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.149308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 376/765] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.149308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.160567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42866a51-bacc-43e0-a80c-8cc6d4dd3815 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.183860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.199601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.200682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.201156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.201620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.202555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.203047 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.204776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.214715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 390/766] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.216040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.252719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53df336-a9fe-424e-ac1d-d2b63060441f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.287702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.288335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.288650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.288984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.289819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=b26193b1206946aea155d1f3114c5898) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.290140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.291567 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.297572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 377/767] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/role_assignments?user.id=b26193b1206946aea155d1f3114c5898&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.298468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.331099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08857a4d-0d81-43dc-89b0-ad6c00d846f6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.333852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.371499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.372977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.373476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.373982 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.383436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.385545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:26.401448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:26.402439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:26.403346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:26.406213 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 391/768] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:26.410493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b450b1c-529c-4718-93f1-6e9b1d706d18 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.413398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.447434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.448200 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.448439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.448729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.449450 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.450039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.451305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.457811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 378/769] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.467089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.476485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.540432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171397c-ab8b-48d8-a630-8665ef163f2b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.578800 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.579839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.580353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.580868 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.582603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.583286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.585030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.600784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 392/770] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.607231 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.630666 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.641672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13478b99-9d8b-45a1-b838-6918bc1c9bd1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.700282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.704989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.705290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.705582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.706943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] RBAC: Adding query filter params (interface=public, service_id=0c22039db90d4bf9b67de2f9db60f8b5, region_id=RegionOne) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:26.707264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.708865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.721466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2d97-f631-4856-aa88-843607bdce60 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.723080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 379/771] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/endpoints?service_id=0c22039db90d4bf9b67de2f9db60f8b5&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:26.729774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:26.740082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:26.767454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.771017 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.772086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.772803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.776602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=8282dd1579c749378efdccf403a539c4, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.778423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ef48a-b207-4ed5-97fc-3afe50f22c9c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.870773 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 393/772] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:26 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 22:46:26.884971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1912f99-6856-45bf-b517-5994c5b0a7b3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:26.924297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:26.925131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:26.925423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:26.925705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:26.926415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:26.927923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99994b1e-f2e6-463c-a235-3e0a1c936779 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:26.934301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 380/773] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:26 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:27.238393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12b0d-c514-4edf-8521-c416ddef9f8c None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.238585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12b0d-c514-4edf-8521-c416ddef9f8c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.238900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f12b0d-c514-4edf-8521-c416ddef9f8c None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.240643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 394/774] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:27.246264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038555f-aa4a-47a4-8348-e4dfaf160820 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.246719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038555f-aa4a-47a4-8348-e4dfaf160820 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.246901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038555f-aa4a-47a4-8348-e4dfaf160820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.269513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-d038555f-aa4a-47a4-8348-e4dfaf160820 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:27.270748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-d038555f-aa4a-47a4-8348-e4dfaf160820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:27.293581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:27.357126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 381/775] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:27.396489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f12b0d-c514-4edf-8521-c416ddef9f8c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:27.558678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f12b0d-c514-4edf-8521-c416ddef9f8c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:27.609942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:27.610765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.611060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.611348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.612020 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:27.613636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7f1e-493a-4595-9bb4-22b950ad554e None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.613978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7f1e-493a-4595-9bb4-22b950ad554e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.614083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:27.614241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb7f1e-493a-4595-9bb4-22b950ad554e None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.615847 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 382/776] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:27.621214 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.621511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.621800 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:27.627257 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:27.628319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:27.629247 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 395/777] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:27 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:27.635637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:27.661509 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:27.662733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:27.669427 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:27.749054 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce749-0f96-4579-8323-df7f8f8e29f5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:27.790825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:27.791526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.791814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.792099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.792866 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] RBAC: Adding query filter params (name=network) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:27.793286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:27.794911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:27.801205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 396/778] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:27.809273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:27.832874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 383/779] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:27.868249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:27.919194 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae5158-aafb-4dc5-a9ce-72c33d77fab0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:27.955632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:27.956901 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:27.957332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:27.957621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:27.958344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] RBAC: Adding query filter params (type=network) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:27.958659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:27.960316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:27.965864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 397/780] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:27.967173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:27.971744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.034109 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:28.065578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37b589-6212-430e-b63c-b15c3644e260 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.133218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.133218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.133218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.133218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.145147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:28.158000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:28.158967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:28.160458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:28.164430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e1167-d3cf-4aa5-82aa-fdcaf6011044 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.173504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 384/781] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:28.174419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.231516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.232192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.232504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.232791 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.233805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] RBAC: Adding query filter params (interface=public, service_id=de293bfb008043d7bc1f635482ca2299, region_id=RegionOne) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:28.234132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:28.237398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:28.255514 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 398/782] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:27 2022] GET /identity/v3/endpoints?service_id=de293bfb008043d7bc1f635482ca2299&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:28.260873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.300799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:28.319456 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea7ecc-3ada-4b62-9f7a-61491bb3b519 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.367849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.368996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.369510 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.370003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.371034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:28.371574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:28.373586 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:28.384538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 385/783] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:28.390475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.402033 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:28.454845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23337b-b0a6-4702-9dd2-9b7cff703fb9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.511055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e60af-3223-4f37-aaf7-0e9ffaf0b03f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.552491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.552491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.552491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.552491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.552923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:28.552923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:28.558223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 399/784] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/services => generated 772 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:28.565387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.567115 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.567637 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.568127 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.591831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:28.593746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:28.627879 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:28.629405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:28.630319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:28.630319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:28.630319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:28.630319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:28.632369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 386/785] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:28.638195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.769515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:28.787084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c621e-d294-4aec-955a-33d94ee71b1c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:28.823477 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:28.824162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.824481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.824774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.825513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:28.825833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:28.827248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908437-1091-40f3-b14f-2bc3265ae20f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:28.839471 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 400/786] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:28.845181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.846380 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fedf1-1eef-4091-802a-53e7f0406e1d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.846709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fedf1-1eef-4091-802a-53e7f0406e1d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.847011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fedf1-1eef-4091-802a-53e7f0406e1d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.848637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 401/787] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:28.853650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:28.853948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:28.854234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:28.874898 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:28.876141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:28.955458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 402/788] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:28.978003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:28.985035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.069246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b51d7-e65a-4009-8079-b38d4f033521 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.106279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.146829 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.147802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.148202 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.148625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.157406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.158561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb1f1-5e8c-48b1-8714-fda3d59a09f1 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.159124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:29.179831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:29.181534 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:29.182554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:29.183257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:29.190431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.213734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.214558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.214849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.215134 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.226436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:29.234127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:29.236082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:29.238400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 403/790] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:29.242918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.308094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52deb1d-635d-4b15-881a-0f050dac5d73 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.336785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.348815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.349543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.349834 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.350117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.350974 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:29.351291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.357133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.392310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 388/791] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:29.399131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.467241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc99f9-2c64-4b93-8e88-32f54ebe0511 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.529465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.530157 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.530445 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.530728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.532826 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:29.533219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.534702 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2acb2b-4a58-4bd7-ba7b-198a3c0b0a4f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.536306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.545331 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 404/792] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:29.546765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516772-120d-409d-a72e-e38167e6f0e9 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.552242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516772-120d-409d-a72e-e38167e6f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.552242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516772-120d-409d-a72e-e38167e6f0e9 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.552242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 405/793] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:29.553482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516772-120d-409d-a72e-e38167e6f0e9 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.566161 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71f2ba-fc6d-4293-92e1-05a147270b53 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.610018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.611288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.611579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.611862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.625710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.627441 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7e101a77-8ca1-4236-9c94-fd90a7065ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:29.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:29.646958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:29.647852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:29.647852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:29.647852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:29.647852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:29.654496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 389/794] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:29.656145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c9455-1e5a-49f1-b27b-41484894c13d None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.656667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c9455-1e5a-49f1-b27b-41484894c13d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.657211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c9455-1e5a-49f1-b27b-41484894c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.668012 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516772-120d-409d-a72e-e38167e6f0e9 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.674680 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-db8c9455-1e5a-49f1-b27b-41484894c13d None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:29.675993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-db8c9455-1e5a-49f1-b27b-41484894c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:29.698661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.704144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.704976 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.705270 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.705560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.716649 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.718132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:29.737195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:29.738151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 406/795] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:29.741317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.749665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 390/796] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:29.751676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70f42-b671-4348-9025-1007801741ca None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.752039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70f42-b671-4348-9025-1007801741ca None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.752394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c70f42-b671-4348-9025-1007801741ca None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.756533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 391/797] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:29.757512 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70f42-b671-4348-9025-1007801741ca None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.800738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:29.856980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ed82-5a83-416a-908a-ceda834786c8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.877527 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c70f42-b671-4348-9025-1007801741ca None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:29.900627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.901594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.901887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.902582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.903336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:29.903657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.905636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c43aaf-7cdf-4eec-8978-57190004e2b0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.919823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:29.920525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.920818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.921100 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.921835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:29.922152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:29.923537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:29.926277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 407/798] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:29.927443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:29.927652 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:29.927934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:29.942839 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 392/799] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:29.942839 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:29.949274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:29.950591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:29.960712 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.025344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 408/800] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:30.026190 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.050712 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8529022-10ff-422b-bd4f-f16748e51f13 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.072780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.092579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.093505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.093793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.094080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.094745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.096171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:30.109640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:30.110639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:30.111517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 393/801] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 22:46:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:30.112458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.139630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a229f2b-74d9-4b30-af06-4ce6813ab629 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.174183 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.175040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.175306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.175590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.182306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.183761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:30.198957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:30.199862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:30.200796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 409/802] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:30.201292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.205944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.224949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc28377-ad99-4e1c-aa5c-c8e1a408036b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.262171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.262989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.263279 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.263743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.271190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.272669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:30.287345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:30.288329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 394/803] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:30.289413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.312806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5292b8f-1532-4bd4-b8ab-2bdd902b34b0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.352363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.353211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.353499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.353793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.364789 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:30.372371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:30.373622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:30.374493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 410/804] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:30.375181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.402981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2991-5ea2-4a43-b274-ca5bf85955e0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.438435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.439194 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.439487 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.439771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.441057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:30.441375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.442776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.447886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 395/805] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:30.448903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.459494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.494651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373c5b-cf62-4d63-9498-a725f20f79c3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.532491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.533177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.533464 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.533748 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.534591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:30.534911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.536365 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.550931 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 411/806] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:30.551821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.561987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b2dbd-4295-4d3d-af13-166d872cd40f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.572036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.604974 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.605778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.606067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.606350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.607197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:30.607516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.608996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.632908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 396/807] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:30.632908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.662196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d3b48-6516-4f14-9cdf-2f10dd3450e8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.698816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.699512 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.699802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.700087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.700884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:30.701201 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.702575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.703052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.711324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 412/808] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:30.712288 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.756669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd7ed6-f795-46d3-bb80-19876b536aeb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.799358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.800918 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.801396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.801859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.802814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:30.803351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.804958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.810364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 397/809] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:30.811365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.815662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.836379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256c37f-4d73-4610-8a8f-794779bfb101 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.871608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.872797 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.873095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/df38e733f1f44f4aacbac0f91e545f0b/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.875315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=df38e733f1f44f4aacbac0f91e545f0b, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.876774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.913933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7ed7-dba2-431e-92f5-10f2bb43f2ea None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:30.939580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:30.945944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 413/810] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:30 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/df38e733f1f44f4aacbac0f91e545f0b/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:30.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:30.952861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:30.953724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:30.954030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:30.954318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:30.967322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:30.968946 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:30.990691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:30.991726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:30.992674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:30.992674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:30.992674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:30.992674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:30.992674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 398/811] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:30.992986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.070382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255e5fe-eed6-4df6-a19a-9de0a5c6babd None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.110377 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.111243 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.111469 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.111749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.112287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e044e86-af19-471a-9f10-21e6d82f5307 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.120536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.123005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.124532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-a7e8dcdd-08c8-46ef-8f58-8cb9b82d0330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:31.142354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:31.143279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:31.145136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:31.145136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:31.145136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:31.145136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:31.145136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 414/812] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:31.145497 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25960f1-76a6-4318-924a-5538662c62f4 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.146016 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25960f1-76a6-4318-924a-5538662c62f4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.146121 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25960f1-76a6-4318-924a-5538662c62f4 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.147450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 415/813] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:31.152041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25960f1-76a6-4318-924a-5538662c62f4 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.155009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.155688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.155979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.156265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.157089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.158557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.257268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25960f1-76a6-4318-924a-5538662c62f4 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.265869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 399/814] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:31.267054 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.315281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.319998 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.320769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.321058 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.321339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.322711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:31.323031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.324611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972c50-1e03-403f-b1e9-45bb2d992058 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.342251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 416/815] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:31.344011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.344534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.345316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.366439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:31.368067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:31.403466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d2dfa-2e65-40ab-90d0-3709a6b647ad None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.434486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.449833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.453005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.453005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.453005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.453005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:31.453005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.453853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.463261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 417/816] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:31.464209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.480361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 400/817] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:31.487407 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.590110 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91c251-342e-4de8-afdc-cc5cb87fa303 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.607598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.613077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd36e-2652-4421-867c-69c3f63a5ea2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.637795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.638638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.638929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.639211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.649428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.651799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.661574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.662373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.662661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.662945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.670325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:31.670956 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:31.671852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:31.672803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:31.673221 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.675433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 418/818] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:31.677129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:31.693969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:31.694982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:46:31.695931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:31.700093 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 401/819] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:31.700900 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.730940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.808849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee908-cc80-4cbd-a91b-72368763d4ad None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.820523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5617f90-9045-4043-9445-d48cb104d5a9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.852488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.853584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.853968 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.854375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] PATH_INFO: `/v3/services/network` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.855573 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.857267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.859924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:31.860949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:31.861446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:31.861932 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:31.863548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:31.864107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:31.865771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:31.870639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:31.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:31.872835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 419/820] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:31.873699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.900449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 402/821] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:31.901809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:31.921661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:31.995207 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c86385-a376-4cd0-9865-8c365196765b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:31.998827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.019491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee9edd-9f85-497f-95ec-d4e0b58d74fb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.039078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.039771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.040072 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.040361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.041253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:32.041576 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.043023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.066807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 420/822] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:32.067951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.080818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.082509 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.083201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.083734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.084985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] RBAC: Adding query filter params (name=network) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:32.086012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.087885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.095624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 403/823] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:32.098006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.184978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2c34a-4bc1-40cd-a1c9-87ebf872c6d3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.206758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.229282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891390b3-8034-49c0-ade0-dbe2ecfd542e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.231580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.236601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.236601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.236601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/b26193b1206946aea155d1f3114c5898/roles/75e56e8718a744f3859938742628d571` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.252809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=b26193b1206946aea155d1f3114c5898, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.254764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.267831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.268754 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.273590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.273590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.339767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 421/824] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:32 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/b26193b1206946aea155d1f3114c5898/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:32.341033 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.346142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.347730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.357098 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.478421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38446ecb-f0bc-4dec-8625-17acb0479f71 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.524594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.525643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.526139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.526622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.527584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] RBAC: Adding query filter params (type=network) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:32.528091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.529517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.537724 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 422/825] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:32.543284 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.551981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.578838 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 404/826] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:46:32.586903 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.638936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.671211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aea72c-7122-4770-b7b3-0f5aec7c1e22 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.701062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263123-076d-4fea-941c-b1a73766fcb2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.714895 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.715916 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.716444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.716950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.717910 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.719511 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.748347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.749095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.749384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.749663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.760874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.762345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:32.782119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:32.783097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:32.784025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:32.784025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:32.784025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:32.784025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:32.784025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 405/827] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:32.790039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:32.805032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 423/828] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:46:32.838839 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:32.937027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8d2f4-516e-494a-bfec-6c4358ad99f2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:32.982435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:32.983133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:32.983419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:32.983696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:32.984458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:32.984771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:32.986179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff99c2-e5f4-4a1f-a50e-438a7fb89032 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.000453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 406/829] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:33.006052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.118211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079cd42-6280-4d4b-b953-7fe5bbdb449d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.149699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.153450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.154252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.154539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.154818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.162639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:33.164102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.168792 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1682a3-a89c-4f33-a775-bb81a4b974c4 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.169332 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1682a3-a89c-4f33-a775-bb81a4b974c4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.169958 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1682a3-a89c-4f33-a775-bb81a4b974c4 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.171967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 407/830] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:33.178197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.178716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.179222 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:33.180570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:33.181466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:33.182357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 424/831] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:33.189397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.202963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:33.204502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:33.285111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 408/832] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:33.295821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55e909-40fc-465a-b91e-135c663a6f0c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.307858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.327827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.333225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.334059 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.334173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.334453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.335255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:33.335639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:33.337118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.350802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 425/833] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:33.365968 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.424541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b7ec9-5c95-4097-9887-8a6d2585aa29 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.428817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.460304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.461559 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.462007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.462617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.474035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:33.475374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4131af-abcf-48a0-8445-c1413d00f841 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:33.482369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:33.483293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:46:33.484122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:33.487006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 409/834] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:33.493009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.510888 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633866c3-105a-4286-bece-3971566f3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.511601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633866c3-105a-4286-bece-3971566f3178 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.511897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633866c3-105a-4286-bece-3971566f3178 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.512192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633866c3-105a-4286-bece-3971566f3178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.513138 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633866c3-105a-4286-bece-3971566f3178 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:33.513460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633866c3-105a-4286-bece-3971566f3178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:33.515141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633866c3-105a-4286-bece-3971566f3178 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.528686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 426/835] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:33.583182 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.607103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b78cf-3d7a-43c1-a75d-ef02b4e08e84 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.646665 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.647370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.647662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.647951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.648751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:33.649070 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:33.650497 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cab85e-2b21-433e-b3e5-4434654e181b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.660361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 410/836] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:33.669617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633866c3-105a-4286-bece-3971566f3178 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.688155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b724c-9f1c-44a3-84a0-2a3e6342badf None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.688517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b724c-9f1c-44a3-84a0-2a3e6342badf None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.688821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b724c-9f1c-44a3-84a0-2a3e6342badf None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 411/837] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:33.697982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.698318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.698556 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.718358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:33.719867 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:33.807428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633866c3-105a-4286-bece-3971566f3178 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:33.813724 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 412/838] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:33.824861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.839626 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.848618 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:33.850444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:33.850943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:33.851407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:33.869508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:33.872249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:33.894446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:33.895307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:33.896196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:33.896196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:33.896196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:33.896196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:33.897906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 427/839] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:33.903571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:33.934475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:33.967258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285c76-a104-416f-a3f6-516cef19cedf None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.005780 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.006622 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.006917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.007203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.007869 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.009294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:34.023542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:34.024573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:34.025431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 413/840] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:34.030524 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.042526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1381550-8c33-4e81-81c4-7484d246d208 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.093420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.095035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.095531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.096252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.097495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:34.098446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.100287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.121042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 428/841] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:34.122095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.146842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72616bbf-ebb4-49f7-9eca-56cf124b160f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.180767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.188885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.189569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.189861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.190143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.191521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:34.191837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.193294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.194640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.203555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 414/842] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:34.204694 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.259921 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47dbc95-f344-411e-865c-b2b4d1cb071b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.304525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.306069 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.306533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.306887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.316979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.318377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adc08-0620-4751-bbd4-6216ee7e13a9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.318682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:34.333527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:34.334756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 22:46:34.335945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:34.337691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 429/843] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:34.343624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.363483 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.364424 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.364821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.365391 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.366415 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:34.366876 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.368427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.380746 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 415/844] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:34.456934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3d19a-5eb5-4539-bbe2-12e239605ba9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.460637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.496195 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.496931 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.497222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.497509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.498663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:34.498979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.500469 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cd12f-2c59-496b-a806-00a1ae251e25 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.521414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 430/845] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:34.527038 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.598005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.640002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb7a8-d61b-4a95-b761-975f6e8ac183 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.664425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec417-94b9-4c3b-b20f-1043a98b5579 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.666553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec417-94b9-4c3b-b20f-1043a98b5579 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.666553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec417-94b9-4c3b-b20f-1043a98b5579 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.666839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 431/846] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:34.672854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.673153 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.673448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.684320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.685752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.686254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.687026 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.690778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:34.691981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:34.772457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 432/847] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:34.774757 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:34.776295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:34.794394 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.867660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.884329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:34.913759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0816aa-a630-413c-8842-01b3d08077d2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:34.930399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 416/848] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:46:34.944436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:34.956798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:34.957708 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:34.958145 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:34.958528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:34.969496 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:34.977900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:34.979126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:46:34.980260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:34.984425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 433/849] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:34.989339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.056919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d7cad-7ad7-4079-8dd6-b82279aad670 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.092793 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.093598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.093891 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.094180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.099803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad390a40-ce22-42e6-b0c3-08105286916b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.105312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.106791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:35.125602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:35.127701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:35.130402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:35.130402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:35.130402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:35.130402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:35.140427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 417/850] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:35.140427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.140873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.140873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.140873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.140873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.141492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.141492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.141492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.142055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.150255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.157389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 434/851] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:46:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:35.158344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.238323 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d45d-82dd-4340-9783-5500a640a204 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.269559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb8f89-3999-4b2d-bca0-c488fae327aa None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.274929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.275688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.276054 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.276425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.277255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.277648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.279102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.295797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 418/852] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:35.296804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.307218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.308261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.308701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.309054 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.321073 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.322743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:35.342391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:35.344219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:35.346411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:35.346411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:35.346411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:35.346411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:35.352423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 435/853] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:35.352423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.377508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.403857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba38f5-3203-4b7a-907a-cb7bf5c8f265 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.409256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.443207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.444217 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.444511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.444874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.452224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.453802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:35.469005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:35.470119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:35.471315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:35.474143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171d95-564a-4071-b94f-915c6df456e3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.477394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 419/854] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:35.478121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.523108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.523793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.524648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.524944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.525682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.525999 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.527840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.543580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 436/855] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:35.549603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.610363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77f9ee-c6bc-4162-8f31-58b039dabb6f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.650174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.651295 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.651789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.652373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.653410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.653931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.655700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.657703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.670042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 420/856] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:35.676466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c54425-da7f-4c7d-9ec8-304b2369cb28 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.676616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.701057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.713452 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.714283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.714573 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.714852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.723273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.725166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:35.742607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:35.743585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:35.744599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:35.748995 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 437/857] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:35.750396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.796310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662408e5-1e72-4392-86f6-2e63052b552e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.835917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.836932 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.837812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.837812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.838326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=df38e733f1f44f4aacbac0f91e545f0b) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.838647 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.840133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d1dc-2ad8-4663-8a4e-da64f0e59416 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.846212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 421/858] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/role_assignments?user.id=df38e733f1f44f4aacbac0f91e545f0b&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:35.848059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fbd04-4fda-4d81-83e3-f7f8833164d8 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.848334 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fbd04-4fda-4d81-83e3-f7f8833164d8 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.848642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fbd04-4fda-4d81-83e3-f7f8833164d8 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.850039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 422/859] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:35.855650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.855951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.856222 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.870832 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794d33-2a48-44de-969b-4fd217ff67d5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:35.878296 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:35.879631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:35.919499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:35.920231 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:35.920633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:35.920990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:35.921923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:35.922309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:35.923928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:35.949037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 438/860] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:35.950785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:35.962073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:35.987842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 423/861] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:35.988852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.007155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.078911 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54fbe1-3cab-4b34-918d-bfb5ec6d2684 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.118407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.119875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.120387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.121052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.132604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c25f-f068-45f0-ae71-1bfe1e9d21eb None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.181570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.182307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.182593 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.182872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.184720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.186399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:36.205073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:36.206674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:36.207543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:36.212491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.212491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.215265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 424/862] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:36.216620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.245554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.273887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.326715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec279887-66e6-4698-b0dd-c72d7507b8f1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.341251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 439/863] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:46:36.348689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.370051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b25d2-451c-436c-911a-94347491e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.370844 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b25d2-451c-436c-911a-94347491e88c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.371210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b25d2-451c-436c-911a-94347491e88c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.371675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b25d2-451c-436c-911a-94347491e88c None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.372457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b25d2-451c-436c-911a-94347491e88c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:36.373317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b25d2-451c-436c-911a-94347491e88c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.374649 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b25d2-451c-436c-911a-94347491e88c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.384618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 425/864] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:36.386087 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b25d2-451c-436c-911a-94347491e88c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.482176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde343f6-faa9-4116-8fd5-e2cc18cd9709 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.507574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b25d2-451c-436c-911a-94347491e88c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.508495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.518377 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.520075 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.520654 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.524342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.527805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.532545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.534829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.549423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.553064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.553064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.553064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.553064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:36.553064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.553905 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f60002-0305-4cb4-af0b-559b74fee8d2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-80de43a8-c2a4-4ae1-98f7-529a4c7b35a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:36.554062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:36.556220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 440/865] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9984-e12f-4c03-a0f7-f66e90e9d6a4 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9984-e12f-4c03-a0f7-f66e90e9d6a4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee9984-e12f-4c03-a0f7-f66e90e9d6a4 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.561040 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 441/866] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:36.561610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee9984-e12f-4c03-a0f7-f66e90e9d6a4 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.564434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 426/867] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:36.565981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.566273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.566555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.589999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:36.591549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:36.686229 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 427/868] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:36.710943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.719496 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee9984-e12f-4c03-a0f7-f66e90e9d6a4 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.772504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.774252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.774918 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.775531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.776804 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:36.777783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.779458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.797037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 442/869] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:36.802445 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:36.833919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96187a6-cdf8-4a06-b8ca-16f499dc3d9f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.848436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.848603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:36.871654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.872336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.872664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.873207 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.874016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.875557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.913694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1322fb-4dc3-417b-bb9e-2e6c9c0c7264 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:36.948390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:36.949215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:36.949503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:36.949785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:36.957219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:36.958674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:36.976554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:36.977533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:36.978549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:36.979885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 428/871] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:36 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:36.981031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 443/871] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:36.982858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:37.117804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf4642-7772-4be4-b860-76e5ce1e1210 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:37.158225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:37.158902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:37.159234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:37.159518 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:37.160316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:37.160734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:37.162191 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c1222-9cc6-427f-ba89-f8830fdc7010 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:37.175317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 429/872] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:37.180935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:37.289088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:37.293339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb3226-2e0d-41a1-989a-b01574c2c66e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:37.331619 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:37.332608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:37.333064 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:37.333503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:37.334888 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=b26193b1206946aea155d1f3114c5898) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:37.335492 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:37.337124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbae93d-f07a-465d-bc24-58531dfb73a3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:37.344472 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 444/873] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:37 2022] GET /identity/v3/role_assignments?user.id=b26193b1206946aea155d1f3114c5898&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:38.053511 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bf1a-c1c8-44de-9002-cef28eeaf3b7 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.054053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bf1a-c1c8-44de-9002-cef28eeaf3b7 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.054142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bf1a-c1c8-44de-9002-cef28eeaf3b7 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.055695 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 430/874] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:38.061164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.061468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.061761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.078735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:38.079934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:38.152842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 445/875] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:38.175361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831bf1a-c1c8-44de-9002-cef28eeaf3b7 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:38.208197 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:38.285494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831bf1a-c1c8-44de-9002-cef28eeaf3b7 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:38.320416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f329a-a486-4fac-95ab-506000785153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:38.321241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f329a-a486-4fac-95ab-506000785153 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.321533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f329a-a486-4fac-95ab-506000785153 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.321819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f329a-a486-4fac-95ab-506000785153 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.322488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f329a-a486-4fac-95ab-506000785153 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:38.323866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f329a-a486-4fac-95ab-506000785153 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-870f329a-a486-4fac-95ab-506000785153 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:38.337050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:38.338052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:38.338930 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 431/876] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:38.344597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:38.447827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:38.457526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b312dd-1f61-45d8-ba9a-9cc006b0c023 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:38.492550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:38.493230 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.493525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.493810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.494528 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:38.494851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:38.496226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f8c36-474c-424b-8a8b-990cf2f50fe5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:38.502896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 446/877] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:38.510478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f329a-a486-4fac-95ab-506000785153 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:38.604756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:38.615722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f329a-a486-4fac-95ab-506000785153 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:38.654039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:38.655142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.655626 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.656101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.657042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:38.657553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:38.659169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1aa3-f880-40f8-8d69-fdc953e87da1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:38.664626 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 432/878] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:38.688552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f8a5-3120-46ff-92cc-6c38314ea8b8 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.688853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f8a5-3120-46ff-92cc-6c38314ea8b8 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.689132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f8a5-3120-46ff-92cc-6c38314ea8b8 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.692541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 447/879] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:38.697442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a7bb-7242-402d-be80-7ec0e5ac178f None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.698904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a7bb-7242-402d-be80-7ec0e5ac178f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.699392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a7bb-7242-402d-be80-7ec0e5ac178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.717848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-4a30a7bb-7242-402d-be80-7ec0e5ac178f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:38.719406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-4a30a7bb-7242-402d-be80-7ec0e5ac178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:38.797743 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 433/880] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:38.822130 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f8a5-3120-46ff-92cc-6c38314ea8b8 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:38.939280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f8a5-3120-46ff-92cc-6c38314ea8b8 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:38.975346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:38.975946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:38.976241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:38.976560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:38.977291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:38.978749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9ee4b-e744-4043-ac3d-2a6b3dfc2a4e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:39.092624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 448/881] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:38 2022] POST /identity/v3/services => generated 269 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:39.188550 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58c2-0d43-4452-ad35-30f94210111d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.189103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58c2-0d43-4452-ad35-30f94210111d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.189103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58c2-0d43-4452-ad35-30f94210111d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.190579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 434/882] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:39.196423 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.196732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.197023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.215555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:39.216825 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:39.229826 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:39.298361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 449/883] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:39.322844 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc58c2-0d43-4452-ad35-30f94210111d None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.413325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:39.434360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc58c2-0d43-4452-ad35-30f94210111d None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:39.470788 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:39.471702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.472469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.472758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.473428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:39.474823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-3f6415bf-e4c3-4da1-ad9a-2edb97fa672f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:39.487374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:39.488382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:39.489260 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 435/884] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:39.494575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.597730 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc12ebc-c741-439e-bcb7-1a286c64fd7b None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:39.633827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:39.634506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.634796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.635078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.635852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:39.636177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:39.637592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:39.642508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d0d8-2095-4c57-943c-7cc3998a7bf0 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.642854 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 450/885] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:39.642989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d0d8-2095-4c57-943c-7cc3998a7bf0 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.643288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35d0d8-2095-4c57-943c-7cc3998a7bf0 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.648447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 436/886] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:39.649558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.650049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.650347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.650633 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.663178 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:39.668077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:39.669339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:39.744841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 437/887] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:39.765496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.767682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a6b4-1079-42cd-bded-7256719197fa None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:39.812301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:39.813537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.814019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.814315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.815244 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:39.815623 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:39.817774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:39.824851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 451/888] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:39.831200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.856039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:39.884131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811a998-2386-438a-a90d-79bc770f57dc None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:39.928357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:39.933704 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:39.934541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:39.934833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:39.935118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:39.949357 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:39.960683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:39.961673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:39.962538 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:39.964479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 438/889] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:39.967971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:39.971454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71290-7f75-4d3d-bd9d-c653c1ad7a35 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.009057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.009691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.009940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.010232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.011087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] RBAC: Adding query filter params (interface=public, service_id=f6405c95491b4f3298ebe0af88e64525, region_id=RegionOne) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:40.011433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.012882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.023753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 452/890] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/endpoints?service_id=f6405c95491b4f3298ebe0af88e64525&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:40.025301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.100390 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fff4-ca6f-46a6-8cc0-90c9ce601e79 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.130486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c6b5-0d15-426e-9dc8-4ab6026c5df1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.145236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.146449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.146938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.147551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.148659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:40.149002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.150409 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.157350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:40.168432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 439/891] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:46:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:40.169199 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.176144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.176876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.177169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.177455 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.178157 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.179602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.181018 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:40.192955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 453/892] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:46:40.291558 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946d486-96fa-431e-aa86-ff0926224b56 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.334765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.335978 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.336570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.337060 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.349915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.351735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:40.370600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:40.371620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:40.372764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:40.372764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:40.372764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:40.372764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:40.374582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 440/893] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:40.380900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.487749 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b0e13-cdf2-49d3-99a4-1acccd4794c5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.524162 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.525554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.526008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.526451 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.527346 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:40.527809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.529362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.542422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 454/894] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:40.548185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.608530 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:40.659210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6438df-d3d5-4f95-8383-7585fda47092 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.694716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.695535 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.695822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.696105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.704174 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.705668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-685fe9d9-95d5-4621-ae29-0ecc4dc2f4d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:40.721362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:40.722412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:40.723394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 441/895] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:40.730310 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.794173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:40.812947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88dce-2958-4a91-9633-4c71e0e46ef3 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.813253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88dce-2958-4a91-9633-4c71e0e46ef3 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.813517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88dce-2958-4a91-9633-4c71e0e46ef3 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.815195 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 442/896] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:40.820943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.821226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.821499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.840703 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48955a-6186-42c8-8e23-8ab79d4dcfa8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:40.846853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:40.846853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:40.888428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:40.888428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:40.888428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:40.888428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:40.888852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:40.888852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:40.888852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:40.914046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 455/897] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:40.915045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:40.930516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 443/898] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:40.958775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.006552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.029814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebe7c5-5e5c-4e40-b6ff-a06f40c1c95a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.047803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.068136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.069131 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.069635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.070040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac6026-3d07-4d86-9747-23b66162a0a6 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.070358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.106506 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.106906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.107205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.107493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.108233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.110660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.143689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.145663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a1ea7-5922-4500-93ea-804a9b78b095 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.190224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 444/899] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:40 2022] POST /identity/v3/services => generated 241 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:46:41.257612 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 456/900] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:46:41.268502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.275235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6db99-601c-489f-87a6-9427d2b07a8e None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.275600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6db99-601c-489f-87a6-9427d2b07a8e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.275807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6db99-601c-489f-87a6-9427d2b07a8e None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.281550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 457/901] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:41.283398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.283769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.284696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.304852 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:41.306367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:41.321607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.389393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.394440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5b67-8901-44b0-b15c-c2762137b2a5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.398027 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 458/902] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:41.422190 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.447132 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.447987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.448328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.448668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.464440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.466875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:41.490673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:41.491830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:41.492835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:41.492835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:41.492835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:41.492835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:41.492835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 445/903] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:41.498680 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.548102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19eeb61-24e7-4a54-860e-bb43fec97104 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.597683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.598890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.599332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.599929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.601140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.602936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:41.618914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:41.620029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:41.620902 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:41.622155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca1ec3-e181-4a0a-ab26-2cedce0c2dee None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.623886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 459/904] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:41.633351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.665026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.666163 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.666842 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.667131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.667416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.668148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:41.668492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.670265 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.682633 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 446/905] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:41.688377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.705255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.762476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639cb70f-97ce-462a-bd60-7b42ef1e258b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.799994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.801694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.801694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.801694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.802300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:41.802682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.804135 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.813861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 460/906] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:41.815372 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.829923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdbb12-e7fb-4d29-8bfd-0276f3c7c0cd None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.867351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.868156 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.868478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.868811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.876317 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.878312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:41.896275 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:41.897258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:41.898138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:41.900705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 447/907] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:41.906468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:41.926871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:41.953275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336ce1-3712-4dbc-950f-0bf5fdf9a2a1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:41.990181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:41.990929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:41.991223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:41.991725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:41.992325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:41.992680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:41.994118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.004639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.005046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 461/908] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.006396 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.049011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e9908-073e-48b4-8a0e-915762945221 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.085776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.086285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.086576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.086857 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.087705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:42.088025 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.089526 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.107508 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 448/909] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.109495 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.136529 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfffc4-8d51-432f-94d3-b1f3d410489d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.175799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.176767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.177159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.177545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.178448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] RBAC: Adding query filter params (interface=public, service_id=6a541618029146acb01dc87e14ece17e, region_id=RegionOne) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:42.178869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.180474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.191292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 462/910] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/endpoints?service_id=6a541618029146acb01dc87e14ece17e&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.192636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.195990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.234077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f514bb-78a1-41a6-abb2-e05a4692627e None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.267443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.274778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.275558 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.275910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.276254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.277311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] RBAC: Adding query filter params (role.id=1a8bd9a6897f4b6097422675238001ea, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=b26193b1206946aea155d1f3114c5898) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:42.277693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.279470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19595ef6-17c5-40c0-b427-7c1e36772cf5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.292432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 449/911] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/role_assignments?user.id=b26193b1206946aea155d1f3114c5898&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=1a8bd9a6897f4b6097422675238001ea => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.323268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b004ee-dd24-4f80-9ca4-c8d4a12bfa89 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.361706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.363119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.363475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.363760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.364636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.364814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6ce18-1188-4fb3-90ad-90331070a9d2 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.365092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6ce18-1188-4fb3-90ad-90331070a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.365380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6ce18-1188-4fb3-90ad-90331070a9d2 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.366113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.367069 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 450/912] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:42.372232 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.372899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.373446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.376323 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 463/913] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:46:42.392965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:42.394217 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:42.478552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 451/914] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:42.504034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.579683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.616447 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3e10-e4ce-4183-90ea-ed78c6b89f8f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.650961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.651703 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.652005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.652297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.653007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.654421 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:42.667366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:42.668689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 22:46:42.669520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:42.673802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 464/915] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:42.680745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.786464 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be911-2870-4062-bc69-6017605ff3c1 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.812148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.823403 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.824099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.824422 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.830173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.830173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:42.830173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.830173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.833142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 452/916] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.838596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:42.948533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcf6-0586-467e-8657-d045b978cea7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:42.978684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:42.984848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:42.985540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:42.985834 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:42.986127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:42.986851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:42.987263 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:42.988681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ede4-be90-4eb8-88ed-cc4955205de0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:42.994256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 465/917] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 22:46:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:42.999906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:43.114403 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298885a-afcc-4c0d-a33c-6c11124ba0e7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:43.150472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:43.151141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:43.151433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:43.151718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:43.152510 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:43.153886 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d48d3-a943-4b91-baa1-a5a42b2a8cbd None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:43.233185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 453/918] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:43.438310 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ddba-1f2b-4101-82ed-6d3eb011fec4 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:43.438682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ddba-1f2b-4101-82ed-6d3eb011fec4 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:43.438897 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845ddba-1f2b-4101-82ed-6d3eb011fec4 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:43.441048 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 466/919] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:43.446648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:43.447086 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:43.447304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:43.465287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:43.466556 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:43.511976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:43.546374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 454/920] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:43.569884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845ddba-1f2b-4101-82ed-6d3eb011fec4 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:43.681009 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845ddba-1f2b-4101-82ed-6d3eb011fec4 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:43.717940 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:43.718764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:43.719056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:43.719344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:43.720010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:43.721435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:43.733780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:43.736113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:43.738745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 467/921] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:43.744942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:43.844730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7929906-b0ca-4eaa-b4bb-89e9ca9d0184 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:43.884783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:43.884783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:43.884783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:43.884783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:43.885610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:43.885610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:43.885610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:43.895473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 455/922] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:43.895732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:43.958986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:44.003168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785b70-60a2-4e7e-b394-2e28e463f3ae None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:44.039339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:44.040031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.040376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.040697 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.041431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:44.041754 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:44.043145 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:44.048788 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 468/923] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:44.054640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:44.090486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:44.159760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d686a-3a34-4195-8cca-7b28dbf09f5c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:44.195505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:44.196177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.196498 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.196786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.197591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] RBAC: Adding query filter params (interface=public, service_id=67bceefb97cc4bc3b9920b46ca0a4c19, region_id=RegionOne) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:44.197911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:44.199305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9463b9-f882-47ce-85c6-dbed1814954f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:44.205139 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 456/924] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:44 2022] GET /identity/v3/endpoints?service_id=67bceefb97cc4bc3b9920b46ca0a4c19&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:44.211281 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:44.318055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714e6e-d656-4b1e-a8a4-af69afa57c97 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:44.351319 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:44.355000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:44.355691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.355984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.356276 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.357014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:44.358403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e9b4f-78a0-41d2-9904-a84d52718705 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:44.365001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 469/925] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:44 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:46:44.482452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16a7c-32d8-4c05-bafc-269066bc3ade None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.482939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16a7c-32d8-4c05-bafc-269066bc3ade None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.482939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae16a7c-32d8-4c05-bafc-269066bc3ade None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.484584 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 457/926] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:44.491141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.491443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.491731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.521593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:44.522839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:44.599696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472c79c-d965-403a-9ce1-8bc8da0a9d4e None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.599989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472c79c-d965-403a-9ce1-8bc8da0a9d4e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.600302 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472c79c-d965-403a-9ce1-8bc8da0a9d4e None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.605758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 458/927] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:44.607329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.607629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.607915 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.609190 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 470/928] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:44.633579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:44.639791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:44.641054 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:44.728424 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 459/929] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:44.774687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:44.782726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61788c07-f617-4e42-8f2c-7dfac48bbef2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:44.805833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:44.821290 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:44.822607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.823075 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.823541 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.837051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:44.837566 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:44.847543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:44.848691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:44.849638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:44.854275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 471/930] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:46:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:44.859933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:44.953767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54b305-eb84-41d9-83e7-b352e9bed06e None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:44.993225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:44.993761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:44.994049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:44.994329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:44.994990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:44.996363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.009233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3df16b-4cf3-4a82-92e4-c2d871ebf5d1 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:45.010393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:45.011321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 22:46:45.012167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:45.017262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 460/931] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 22:46:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:45.017387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.060273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.061837 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.062386 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.063293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.064716 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:45.066084 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.067987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.081835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 472/932] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:46:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:45.088441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.122049 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.132811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ada57-8a25-4081-be4e-908f6f41ffd0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.143513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.181612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.182590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.183042 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.183477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.184642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:45.184947 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.186469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.195104 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 461/933] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:45.200913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.216318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d9b8f-4418-4677-93cb-62eaf5e2ead4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.258761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.260168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.260680 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.261418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.276283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.278540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:45.303883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:45.304863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:45.305813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:45.305813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:45.305813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:45.305813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:45.312937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 473/934] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:45.313985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.325374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c3211-93bc-4d99-8101-55b9ce4e4627 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.362969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.364121 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.364248 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.364673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.365490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:45.365907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.369413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.382241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 462/935] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:45.383347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.406623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.437194 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.450399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef711db-b62c-495a-aac7-f392ddf0b873 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.490507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.491184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.491477 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.491763 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.492542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:45.492862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.494245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe578cd4-9101-4497-bc9a-9e97e0c453de None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.496036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2ca9a-ed52-4fca-aec9-312e6d98e441 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.506862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 474/936] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:45.507990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1269-a39b-463f-9385-a9845cb8e808 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.508287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1269-a39b-463f-9385-a9845cb8e808 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.508606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1269-a39b-463f-9385-a9845cb8e808 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.509989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 475/937] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:45.512534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1269-a39b-463f-9385-a9845cb8e808 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.542401 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.543491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.544248 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.544726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.545763 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.547485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda0a28-f2d9-48b0-9c31-bbe6abc13972 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.615609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1269-a39b-463f-9385-a9845cb8e808 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.651030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 463/938] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:45.652304 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.652642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.652935 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.669681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.670669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.671074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.671419 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.674439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:45.677229 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:45.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.683364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:45.700476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:45.701517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:45.702572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:45.706829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 476/939] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:45.707810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.718629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.786562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 464/940] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:45.813739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.823225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:45.831266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a16de-a094-400f-a566-5dfbbf99de1e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.873927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.874809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.874809 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.875086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.875995 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:45.876317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.878005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.903004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 477/941] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:45.908593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:45.948608 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914826-adb8-4d04-bffc-c3ccdd731511 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:45.985822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:45.986495 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:45.986843 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:45.987159 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:45.987878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:45.989361 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:45.990747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: WARNING keystone.server.flask.common [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 22:46:45.992961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.039938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8578c-5560-4d7d-af3b-b17091f9b134 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.056426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.sql.core [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:46:46.056426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 22:46:46.056426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [parameters: {'id': 'c7cc5a008be04650bd85ff2b7e6b2cbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 22:46:46.056426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=155869) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7cc5a008be04650bd85ff2b7e6b2cbe.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7cc5a008be04650bd85ff2b7e6b2cbe. Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:46:46.072941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application result.read() Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 22:46:46.073832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application yield resource Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise self.value Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application session.commit() Jun 29 22:46:46.074786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:46:46.075684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:46:46.078976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application result.read() Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:46:46.079758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [parameters: {'id': 'c7cc5a008be04650bd85ff2b7e6b2cbe', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:46.082001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c7cc5a008be04650bd85ff2b7e6b2cbe. Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 465/942] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 22:46:45 2022] POST /identity/v3/projects => generated 262 bytes in 261 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:46.083520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.083610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.083704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.083704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.083704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.101283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.104504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:46.128457 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:46.129565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:46.130727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:46.130727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:46.130727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:46.130727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:46.130727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 478/943] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:46.137556 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.156440 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.203620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88bc8e-5ce3-4b67-8fa6-dd7483f25418 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.242548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.243349 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.243641 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.243923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.251297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.253082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.257371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e26735-ee7e-47fc-a032-71504c3b3f88 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:46.267364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:46.268347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:46.269951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:46.274075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 466/944] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:46.274946 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.279223 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.300001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.301055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.301747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.302316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.303242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:46.303781 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.305640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.324588 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 479/945] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:46.325772 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.384201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6c8ed-8831-4db5-b0e5-7502b5e21eb4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.407706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.419751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.420441 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.420751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.421035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.421796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:46.422107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.423549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.439176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f2da7-de52-45bd-8a84-89540dc8d88b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.452848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 467/946] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:46.485425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.486253 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.486819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.495098 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.496594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-87848490-910b-499a-a7b7-2a472b6ac9df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:46.513000 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:46.514056 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:46.514978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 480/947] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:46.522565 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.595766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38bf-ed1e-4520-bb53-d64dedd54288 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.596063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38bf-ed1e-4520-bb53-d64dedd54288 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.596351 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc38bf-ed1e-4520-bb53-d64dedd54288 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.599221 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 481/948] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:46.603741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.604039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.604329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.626007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:46.627222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:46.642783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf89afe-b5c4-4d8b-8b58-36a51f573b8c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.661042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.686976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.687658 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.687949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.688227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.689056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:46.689420 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.692303 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.705720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 468/949] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:46.716426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.716605 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 482/950] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:46.738196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.768856 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.851384 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6788722-9ff5-4913-91b2-012192f52f22 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.855295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e42e3-2177-49e2-a6d0-28e5bd5478e9 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:46.895896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.897005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.897512 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:46.897750 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.898244 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.898417 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:46.898696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:46.898977 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/b26193b1206946aea155d1f3114c5898/roles/1a8bd9a6897f4b6097422675238001ea` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:46.899725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.901352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=b26193b1206946aea155d1f3114c5898, role_id=1a8bd9a6897f4b6097422675238001ea)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:46.901472 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.902973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:46.914881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:46.916003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:46.920052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:46.921091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 483/951] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:46.922382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:46.959197 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:46.971702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 469/952] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:46:46 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/b26193b1206946aea155d1f3114c5898/roles/1a8bd9a6897f4b6097422675238001ea => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:46:47.053696 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbda64f-8741-445c-9524-f299bc11a1f7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:47.093561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:47.094647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:47.095143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:47.095630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:47.097134 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:47.097675 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:47.099312 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:47.105505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 484/953] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:47.116540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:47.222241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5576-c982-42e2-9f2e-7784892f493d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:47.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:47.257606 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:47.258286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:47.258573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:47.258854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:47.259639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:47.259954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:47.261432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fb498b-c0a8-4076-ab57-79dae61fbea1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:47.270230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 470/954] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:47.273036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:47.376758 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:47.382384 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8c076-752b-47de-b9d5-b705ccbeaebb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:47.418381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:47.419390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:47.419904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:47.420393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:47.421378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:47.422992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bae57b-b3cd-428b-a5d9-cc20a072f8e0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:47.503975 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 485/955] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:47.995794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952e76-4152-438e-be95-87ff9c1f7720 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:47.996312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952e76-4152-438e-be95-87ff9c1f7720 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:47.996630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93952e76-4152-438e-be95-87ff9c1f7720 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:47.998617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 471/956] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:48.003954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.004591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.004591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.022036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:48.023231 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:48.100807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 486/957] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:48.124630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93952e76-4152-438e-be95-87ff9c1f7720 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:48.233120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93952e76-4152-438e-be95-87ff9c1f7720 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:48.269002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:48.269881 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.270171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.270454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.271114 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:48.272526 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:48.285179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:48.287435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:48.289454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 472/958] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:48.296540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:48.372542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:48.396707 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f78f2a-8927-40b5-8e14-02482f58c724 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:48.432200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:48.432908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.433199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.433483 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.434198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:48.434512 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:48.435893 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927e7d7-1dc2-4060-9c9e-19008c1be1e2 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:48.441314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 487/959] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:48.446894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:48.480740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:48.553529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b49b8-1ad8-4373-9dbf-c7d23f0fc7e0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:48.589141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:48.589815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.590101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.590383 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.591097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] RBAC: Adding query filter params (type=compute) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:48.591410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:48.592948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf236d0-74f8-4a52-8e51-f1248524a31d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:48.598638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 473/960] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:48.702207 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dbf8-5376-4991-a596-6d070015ac52 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.702539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dbf8-5376-4991-a596-6d070015ac52 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.702775 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353dbf8-5376-4991-a596-6d070015ac52 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.704540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 488/961] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:48.710922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.711208 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.711494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.729588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:48.731161 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:48.807949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 474/962] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:48.833841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353dbf8-5376-4991-a596-6d070015ac52 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:48.945003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353dbf8-5376-4991-a596-6d070015ac52 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:48.981187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:48.981873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:48.982165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:48.982447 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:48.983159 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:48.984633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:48.985946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: WARNING keystone.server.flask.common [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 22:46:49.036914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.sql.core [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:46:49.036914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 22:46:49.036914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [parameters: {'user_id': 'd5018050a13d4fde868dfd3e8ddacaab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 22:46:49.036914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=155870) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-98b62b6c-2c4a-4f05-8647-4549af652292 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result.read() Jun 29 22:46:49.044795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:46:49.045685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application yield resource Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application next(self.gen) Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise self.value Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application session.commit() Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 22:46:49.047003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.session.flush() Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application compat.raise_( Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 22:46:49.047879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 22:46:49.049272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application conn.query(q) Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application result.read() Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 22:46:49.051633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd5018050a13d4fde868dfd3e8ddacaab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:49.053691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 22:46:49.055580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.057792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 489/963] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 22:46:48 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:49.067315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.091801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.110147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31f52-c09f-4aa8-aed6-db700543669b None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.110460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31f52-c09f-4aa8-aed6-db700543669b None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.110729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31f52-c09f-4aa8-aed6-db700543669b None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.115937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 490/964] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:49.122268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.122578 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.122859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.144768 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.148210 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:49.150340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:49.187198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd865caf-65b7-4534-bf31-b04ba5e579c8 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.224718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.225483 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.225771 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.226056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.233721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:49.235183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:49.247509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 491/965] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:49.254095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:49.255041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 22:46:49.256053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:49.259868 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 475/966] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:49.259983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.271999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.364364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.380714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d73f09-9175-482b-a1cb-d202a1be30fb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.392608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510d9e3-de40-4669-8096-6c5f533b27b7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.423139 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.424383 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.425444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.425784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.428882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.434475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.435489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.436049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.436536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.439095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:49.439095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:49.439292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:49.440303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:49.447460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:49.448496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:49.449374 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 476/967] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:49.457362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 492/968] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:49.572040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb2ef6-a139-43b3-9a4f-d3abe83539d5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.610058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.610752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.611045 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.611334 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.612752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:49.613090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:49.614580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ee64a-dc0c-44da-9b7c-66cb86f57415 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:49.628630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 477/969] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:49.633202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.634640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf44a-7d84-41f7-9bc4-7a4581cdc380 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.634942 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf44a-7d84-41f7-9bc4-7a4581cdc380 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.635235 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bf44a-7d84-41f7-9bc4-7a4581cdc380 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.639632 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 478/970] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:49.642360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.642782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.643138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.656765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.663338 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:49.664547 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:49.750733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 479/971] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:49.770354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee6b97-41eb-4d1f-94bd-630c0cb40160 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.775823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.815146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.816533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.816823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.817108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.828981 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:49.830443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:49.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:49.850759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:49.851643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:49.851643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:49.851643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:49.851643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:49.851643 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 493/972] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:49.856655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.905378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287dc32-e24a-45dd-95ec-5dd2b9838944 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:49.910958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.942469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:49.943277 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:49.943561 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:49.943840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:49.944537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:49.945912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:49.948821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:49.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:49.965831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:49.966682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 480/973] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:49.968703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:49.977550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce723b-e368-4bef-bb0a-4d77b4df5e2f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.013966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.014638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.014924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.015203 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.015932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:50.016243 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.017638 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.034876 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 494/974] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:50.036003 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.080302 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c575c-39ef-4985-8f0b-1f76d3092cf9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.115954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.116653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.116943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.117230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.117940 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:50.118252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.119628 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.130319 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 481/975] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:50.131305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.148215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abae218-6eeb-40a9-8f7a-8d536d513fc8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.150520 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.186810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.187734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.188147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.188453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.195261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.197360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.198817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:46:50.214361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:50.215308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:50.216255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 495/976] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:50.221682 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.240613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4bb5-e9bf-4998-8efa-b6ed40b4027d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.277871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.278543 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.278826 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.279103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.279807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:50.280363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.281689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.287135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 482/977] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:50.292509 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.336551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dba3d-ca6f-49fd-bea2-cff1308d7918 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.373917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.374597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.374903 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.375164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.376039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:50.376358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.378337 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.401827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 496/978] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:50.402776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.406582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da7ad2-1cb6-4a67-a67e-efb2dfec52d7 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.425266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.433572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.442447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.443112 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.443396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.443678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.444500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] RBAC: Adding query filter params (interface=admin, service_id=67bceefb97cc4bc3b9920b46ca0a4c19, region_id=RegionOne) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:50.444819 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.446211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.451663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 483/979] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/endpoints?service_id=67bceefb97cc4bc3b9920b46ca0a4c19&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:50.458054 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.510106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409f45-fbad-4a3e-8cfe-f4eb2fc4b531 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.544551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.545225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.545521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.545808 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.570321 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688f57f-5ae6-4d0d-a786-58d5931262c1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.605939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.606625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.606917 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.607203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.607896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.609315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.617731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.619208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2ae9e-9ff0-49b6-8795-073808f7bd1b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.626698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 484/980] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 22:46:50.644382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.732542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 497/981] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:46:50.735521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.773019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0362-6144-4040-8c62-0ee3ef9fd5a6 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.773324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0362-6144-4040-8c62-0ee3ef9fd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.773565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e0362-6144-4040-8c62-0ee3ef9fd5a6 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.775677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 498/982] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:50.780166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.780500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.780799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.800261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:50.801894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:50.803360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:50.859504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850d5bb-76a0-4676-a82e-b54f20d39261 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:50.874644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 499/983] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:50.897861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.906104 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:50.906912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:50.907200 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:50.907480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:50.919229 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:50.920723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:50.938827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:50.939752 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:50.940722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:50.940722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:50.940722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:50.940722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:50.944757 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 485/984] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:50.945943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:50.953246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:51.012061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474578f-0479-43cf-9a91-9d590f3e4fbf None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:51.048887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:51.049586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:51.050653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:51.051116 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:51.052264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:51.053747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:51.054400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93efd49-e9cd-4c8f-b64e-890da371292f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:51.064154 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:51.088733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:51.089416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:51.089707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:51.089992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:51.090725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:51.091035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:51.092411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:51.105218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 486/985] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:51.110801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:51.142907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 500/986] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:50 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:46:51.222716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccbb16-66f3-4bbd-bc53-323a63cbe7ef None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:51.267327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:51.268084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:51.268938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:51.269227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:51.276859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:51.278347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:46:51.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:51.294745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:51.295679 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 487/987] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:51.301001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:51.410356 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c101fec-ef9f-42da-ae02-631eeeabbc0d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:51.421318 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:51.444820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:51.445495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:51.445787 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:51.446069 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:51.446862 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:51.447185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:51.448636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb01e0-c4b0-4adc-b129-d6a777950d0c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:51.462220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 501/988] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:51.468282 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:51.494761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:51.571065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49ce4b-0d62-461d-a53e-755fb4965513 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:51.604858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:51.605529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:51.605817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:51.606097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:51.606937 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] RBAC: Adding query filter params (role.id=1a8bd9a6897f4b6097422675238001ea, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=b26193b1206946aea155d1f3114c5898) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:51.607253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:51.608711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085b845-6fff-4e1f-aa60-9532d378bbf1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:51.615451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 488/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:46:51 2022] GET /identity/v3/role_assignments?user.id=b26193b1206946aea155d1f3114c5898&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=1a8bd9a6897f4b6097422675238001ea => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:52.708067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906805f0-2d8b-4320-a51b-04da15f0a777 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:52.708609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906805f0-2d8b-4320-a51b-04da15f0a777 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:52.708688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906805f0-2d8b-4320-a51b-04da15f0a777 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:52.710121 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 502/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:52.715287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:52.715698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:52.715883 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:52.733105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:52.734291 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:52.805469 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 489/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:52.828546 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906805f0-2d8b-4320-a51b-04da15f0a777 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:52.939845 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906805f0-2d8b-4320-a51b-04da15f0a777 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:52.974055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:52.974805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:52.975097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:52.975383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:52.976043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:52.977453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:52.989418 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:52.990521 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 22:46:52.991401 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:52.995663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 503/992] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 22:46:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:52.997051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.015766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.098644 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f40a2-b35b-4aa8-a6a8-8dad0166106a None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.142253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.142931 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.143220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.144059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.144816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:53.145131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.146524 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edb901-376d-40e8-9c9e-89917f0d6c24 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.156185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 490/993] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:53.157727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.194077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.225963 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e11a6-3250-422d-83e7-ee4487da3748 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.226253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e11a6-3250-422d-83e7-ee4487da3748 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.226503 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e11a6-3250-422d-83e7-ee4487da3748 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.228030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 491/994] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:53.233014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.233316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.233603 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.250848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:53.252048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:53.264278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45025-45bd-4a69-ab4c-74d999b18ce4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.300061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.300769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.301057 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.301340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.302059 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:53.302374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.303756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.313689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 504/995] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:53.314690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.326596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 492/996] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:53.349939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.365287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.421200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.425884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b2ea-7cd0-437f-9680-1ac9df07e7ac None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.463625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7f7d1-d4a7-43bf-9746-5eaab963f7c9 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.463847 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.464533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.464827 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.465114 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.465873 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.467248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.500581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.501367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.501652 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.501929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] PATH_INFO: `/v3/services/compute` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.502581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.504603 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:53.516151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:53.517198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:53.518073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 493/997] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:53.523076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.548426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 505/998] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:53.621183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.647596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16558e34-75be-4c64-af38-f5a8c4e80dda None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.692152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.692868 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.693158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.693444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.694159 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:53.694474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.695847 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b36ca-e395-4084-88ee-c655959d51b0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.701646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 494/999] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:53.707378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.724557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc256-8f39-404d-a022-15390836a79d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.725085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc256-8f39-404d-a022-15390836a79d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.725182 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fc256-8f39-404d-a022-15390836a79d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.726780 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 495/1000] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:53.732262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.732586 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.732874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.753479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:53.754600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:53.829464 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde33ed-6ca2-4446-b0b6-d88c98f3c769 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.832134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 496/1001] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:53.855614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.868655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:53.869511 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:53.869805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:53.870091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:53.870821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] RBAC: Adding query filter params (type=compute) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:53.871136 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:53.872545 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:53.882582 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 506/1002] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:53.885224 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:53.912254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.933591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:53.970748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1138f-d6ac-4e14-b96b-3e901f425a4a None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:53.991661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d73611-75dd-4f42-a550-18b199f8d505 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:54.007491 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:54.008249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:54.008574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:54.008852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] PATH_INFO: `/v3/services/image` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:54.009516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:54.010911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:54.022631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:54.023653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:54.024579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 497/1003] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:54.030205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:54.031608 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:54.032295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:54.032620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:54.032905 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:54.033741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] RBAC: Adding query filter params (interface=public, service_id=3ee4cb3af5ea4a92bf64d857159d029d, region_id=RegionOne) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:54.034594 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:54.035982 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:54.041584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 507/1004] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:53 2022] GET /identity/v3/endpoints?service_id=3ee4cb3af5ea4a92bf64d857159d029d&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:54.046925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:54.136766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:54.146236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a01d85-a61e-451a-951d-d7b364b28e0f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:54.151838 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5b53e-fa81-42ce-86a1-80aa921175a5 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:54.178624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:54.185009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:54.185688 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:54.185981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:54.186329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:54.187127 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] RBAC: Adding query filter params (name=image) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:54.187444 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:54.188234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:54.188850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:54.188949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:54.189887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:54.189887 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:54.190339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:54.191905 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29087aa1-6b4c-4ae8-8e0a-45c091b429f3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:54.199126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 498/1005] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:54.199284 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 508/1006] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:54 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:46:54.199972 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:54.312376 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fbb62-21c5-45bc-8376-a6c83a80fe45 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:54.350504 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:54.351188 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:54.351477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:54.351760 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:54.352505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] RBAC: Adding query filter params (type=image) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:54.352820 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:54.354212 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f5714-1502-4db5-a2cf-662ad0cf3fa0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:54.359402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 499/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:55.621432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933606-d38e-471d-808a-184354488dec None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:55.621983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933606-d38e-471d-808a-184354488dec None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:55.621983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933606-d38e-471d-808a-184354488dec None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:55.623786 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 509/1008] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:55.628796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:55.629183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:55.629365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:55.645790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:55.646964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:55.699284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:55.716447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 500/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:55.737994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38933606-d38e-471d-808a-184354488dec None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:55.842141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38933606-d38e-471d-808a-184354488dec None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:55.876997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:55.877816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:55.878107 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:55.878442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:55.879629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:55.883720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c54c1-3229-466e-a463-b32cd8f33e04 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:55.890729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:55.890877 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 510/1010] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:55.989141 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573040d6-32eb-46af-b21e-e76c81f8b218 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:56.023600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:56.024266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.024574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.024851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.025570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:56.026996 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650ea23-071a-4027-8c92-f24978a0cbc6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:56.121466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 501/1011] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:55 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:56.284756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f39d8-e585-47b8-a7a0-b93b06036c81 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.285067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f39d8-e585-47b8-a7a0-b93b06036c81 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.286626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f39d8-e585-47b8-a7a0-b93b06036c81 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.286626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 511/1012] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:56.291998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679993-aba8-44ba-8399-b00eaab6df23 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.292298 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679993-aba8-44ba-8399-b00eaab6df23 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.292639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8679993-aba8-44ba-8399-b00eaab6df23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.310263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-b8679993-aba8-44ba-8399-b00eaab6df23 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:56.311451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-b8679993-aba8-44ba-8399-b00eaab6df23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:56.351457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:56.385343 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 502/1013] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:56.408987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f39d8-e585-47b8-a7a0-b93b06036c81 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:56.428907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:56.458647 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b87302-b6bc-46d8-8166-45e41be21fb0 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.458968 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b87302-b6bc-46d8-8166-45e41be21fb0 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.459264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b87302-b6bc-46d8-8166-45e41be21fb0 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.461000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 503/1014] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:56.465701 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.465993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.466276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.482962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:56.484158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:56.521589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f39d8-e585-47b8-a7a0-b93b06036c81 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:56.561376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:56.561699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 504/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:56.562736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.563019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.563303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.563967 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:56.565929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:56.577692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:56.578699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:46:56.579563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 512/1016] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:46:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:56.584837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:56.587833 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:56.676315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:56.689481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:56.693085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16812-8b2e-445b-9f8c-d359ed88261c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:56.700156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11648a-a371-4bff-8a39-0e12f625c5c4 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:56.727791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:56.728502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.728794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.729078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.729914 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] RBAC: Adding query filter params (name=compute) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:56.730106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:56.731493 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:56.735140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:56.735810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.736098 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.741494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.741630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 505/1017] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:56.741737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:56.741737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:56.742442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:56.852433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a861a-7c3a-441e-af56-ec6a82c0ef26 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:56.852664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 513/1018] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:46:56 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:46:56.906467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:56.907154 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:56.907437 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:56.907710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:56.908448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] RBAC: Adding query filter params (type=compute) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:56.908767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:56.910662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c22f23-206e-4188-a912-d3e9062744ac None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:56.921716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 506/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 22:46:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:56.923389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:57.035146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75b838-f792-420c-af0e-cc04bbae833b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:57.068900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:57.069568 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:57.069857 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:57.070140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:57.070892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:57.072255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537b3f4-65bb-4a52-9ade-e4d06e948feb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:57.148695 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:57.155227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 514/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:46:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:46:58.222814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a80d6-ea81-43bb-8752-491fbaf6cc97 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.223312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a80d6-ea81-43bb-8752-491fbaf6cc97 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.223312 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a80d6-ea81-43bb-8752-491fbaf6cc97 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.224736 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 507/1021] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:58.229810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.230189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.230373 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.247258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:58.248460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:58.328449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 515/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:58.353742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a80d6-ea81-43bb-8752-491fbaf6cc97 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:58.380434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:58.457821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a80d6-ea81-43bb-8752-491fbaf6cc97 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:58.494910 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:58.495619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.495902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.496177 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.497377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:58.499067 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca654ce-c10e-45d8-a325-d771657e7916 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:58.504453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 508/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:58.508470 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:58.607539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45567507-e47a-4e99-aa06-01f713dc9af2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:58.631634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:58.642515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:58.645369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.645369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.645369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.645369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:58.646036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52140eb-91e8-4962-b1ee-ab7502efeddd None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:58.741707 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 516/1024] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:46:58 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 22:46:58.934193 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e109b-3088-4b28-a357-4da131abdf10 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.934486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e109b-3088-4b28-a357-4da131abdf10 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.934773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e109b-3088-4b28-a357-4da131abdf10 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.936166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 509/1025] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:46:58.941740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:58.942020 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:58.942313 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:58.960322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:58.961589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:59.040046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 517/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:46:59.063137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e109b-3088-4b28-a357-4da131abdf10 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.161783 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.172138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e109b-3088-4b28-a357-4da131abdf10 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.207572 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.208368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.208683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.208964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] PATH_INFO: `/v3/services/image` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.209650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.211037 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-450c2fd7-32fd-4d6c-b992-2dcebc603988 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:59.222767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:59.224218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:46:59.225668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:59.228472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 510/1027] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:46:59.230034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.299004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f033ea-52f2-4077-b35e-640d5a3bff86 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.299331 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f033ea-52f2-4077-b35e-640d5a3bff86 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.299603 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f033ea-52f2-4077-b35e-640d5a3bff86 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.301024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 511/1028] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:46:59.305821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.306113 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.306395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.323617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:46:59.324827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:46:59.335443 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499d624-433a-41d5-909a-e62a78f0be81 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.346505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.371712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.372391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.372701 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.373146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.373957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] RBAC: Adding query filter params (name=image) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:59.374276 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.375675 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.387091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 518/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:59.387777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.407710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 512/1030] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:46:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:46:59.424329 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.500013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb17d8-613f-4608-bd01-ab3a8fe171ed None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.514830 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.532868 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36ad4a-cbad-4ec6-adca-a5ac2375697f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.537379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.538063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.538353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.538636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.539479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] RBAC: Adding query filter params (type=image) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:59.539802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.541232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.546364 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 519/1031] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:59.552799 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.574801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.575650 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.575938 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.576222 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.587742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:46:59.595878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:59.597102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:46:59.597964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:59.599548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 513/1032] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:59.601156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.603464 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.663935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694185dd-9a1a-4ad1-97b0-d26b5090bfad None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.700861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.701489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.701784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.702070 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.702870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] RBAC: Adding query filter params (interface=public, service_id=17443d34bd374e0185baf9f9eb475560, region_id=RegionOne) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:59.703189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.704599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.709810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 520/1033] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/endpoints?service_id=17443d34bd374e0185baf9f9eb475560&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:46:59.715342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.717030 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78b554-6a3d-4155-b818-2c448e7d31f6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.754373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.755040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.755322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.755597 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.756497 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:46:59.756806 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.758290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.771664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 514/1034] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:46:59.772874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:46:59.784439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.824960 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc9317-6541-4b2e-88fa-f2b29269b500 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.826473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:46:59.860872 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.861765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.862773 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.863060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.863752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.865147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.872275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 521/1035] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 22:46:59.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d172e71-d66c-4b4d-9216-f655d94c3e22 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:46:59.926333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:46:59.927165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:46:59.927453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:46:59.927731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:46:59.941284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:46:59.942837 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:46:59.962075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:46:59.963044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:46:59.963951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:46:59.963951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:46:59.963951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:46:59.963951 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:46:59.968173 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 515/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:46:59.969499 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:00.079523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bce315-9f4a-4f4c-b6ae-4d99a3bf1918 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:00.114281 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:00.114952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.115241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.115523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.116245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:00.116598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:00.117965 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:00.134015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 522/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:00.135699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:00.198290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:00.240016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcebb1f-3721-44ee-9a09-9a60d0f8306c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:00.274602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:00.275398 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.275687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.275965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.283477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:00.285516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:47:00.299305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:00.300276 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:00.301659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:00.304486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 516/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:47:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:00.306661 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:00.336711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:00.419412 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8877f7-e663-4e37-9366-d4b7f867d0a9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:00.453894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:00.454587 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.454937 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.455228 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.456621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:00.456943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:00.458386 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:00.480759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 523/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:47:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:00.482327 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:00.584822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91382431-7207-4102-b732-0593ba0fb879 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:00.605339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:00.619928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:00.620629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.620913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.621203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.689555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:00.691541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7a112-df7a-488b-ab31-39cb86f02e4f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:00.791094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 517/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:47:00.796742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:00.891158 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:00.899421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6707df-63b4-4b4d-ab7b-015f82f154c6 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.899722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6707df-63b4-4b4d-ab7b-015f82f154c6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.903685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6707df-63b4-4b4d-ab7b-015f82f154c6 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.903685 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 518/1041] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:00.906398 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.906696 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.906985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.909440 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f55b0-7bce-4f4d-9761-bfa850127598 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:00.923758 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:00.925018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:00.939211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:00.949044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:00.952721 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:00.952721 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:00.952721 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:00.961936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:00.963405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:00.981731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:00.982647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:00.983819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:00.983819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:00.983819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:00.983819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:00.983819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 524/1042] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:00.989067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.004741 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 519/1043] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:47:01.028703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.095012 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d6093-b896-407c-bd3f-1fbae48c045a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.131508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.131686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9228c5-a0e4-42a8-a71f-682d7b75b3e2 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.132192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.132515 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.132805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.133537 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:01.134538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.135226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.137576 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.166726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 525/1044] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:01.166726 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.179952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.180948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.181562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.181847 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.193473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:01.200954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:01.201985 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:01.202851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 520/1045] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:01.208186 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.221472 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.263494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f2de2-a088-4910-8f8d-bba6ac55d02a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.300900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.301714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.302008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.302298 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.309099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.310539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.317287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e3c59-71cf-41c2-af33-2852f4ba5d73 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:47:01.325340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:01.326232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:01.327172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 526/1046] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:01.332235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.355813 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.356522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.356817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.357105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:01.358186 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.359576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.368756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 521/1047] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:01.374755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.405908 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.449369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.461633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8f1b-88a2-4043-ba06-e97d9fca5cb9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.485713 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fdff1-aed0-4e07-8826-81b098447bb1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.500839 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.501518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.501812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.502181 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.503064 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:01.503388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.504881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.518731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 527/1048] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:01.522039 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.522923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.523213 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.523716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] PATH_INFO: `/v3/users/702be352a0d5464dbbd6f725ffaf76b4` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.524603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.538344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] RBAC: Authorizing `identity:get_user(user_id=702be352a0d5464dbbd6f725ffaf76b4)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.539808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.541735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 522/1049] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/users/702be352a0d5464dbbd6f725ffaf76b4 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:01.547324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.641274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32754d-45f0-4db7-b0d5-3e54b14cbf57 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.650872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee5140-0953-432f-bf58-a406da968b0b None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:01.659438 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.678023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.678691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.678988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.679283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.680125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] RBAC: Adding query filter params (role.id=1a8bd9a6897f4b6097422675238001ea, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:01.680476 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.681979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.682912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:01.687629 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 528/1050] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=1a8bd9a6897f4b6097422675238001ea => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:01.690326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:01.690999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.691290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.691574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.778182 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:01.779599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa024c3-7ebc-4f6c-9763-2b64bed6aad8 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:01.900570 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 523/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 22:47:01.906133 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:01.975367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce55a9-c8e3-47f7-aa8c-e7041f03423f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.975723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce55a9-c8e3-47f7-aa8c-e7041f03423f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.975941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce55a9-c8e3-47f7-aa8c-e7041f03423f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:01.977518 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 524/1052] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:01.982314 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:01.982605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:01.982885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.003228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:02.005308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:02.011639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849cc29-b903-4a07-9f4e-53d9cb556dab None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.039730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:02.048378 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.049494 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.049952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.050406 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.051637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.053100 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.055534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 529/1053] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:01 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:02.061045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:02.092782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 525/1054] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:47:02.106968 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:02.112024 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:02.171073 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33082160-73c3-4d48-bc23-ebdba78da650 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.207983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.208678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.208966 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.209246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.210081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=51f78d621b954d4c80d4003f9d91ff9e, user.id=702be352a0d5464dbbd6f725ffaf76b4) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:02.210400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.210501 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96905004-812d-4e6f-a4e4-f8eedf86da82 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.212094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.217841 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 530/1055] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:02 2022] GET /identity/v3/role_assignments?user.id=702be352a0d5464dbbd6f725ffaf76b4&scope.project.id=51f78d621b954d4c80d4003f9d91ff9e&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:02.248078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.249183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.249468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.249747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] PATH_INFO: `/v3/services/image` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.250413 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.251823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:02.264912 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:02.266031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:02.272936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 526/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 22:47:02 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:02.273769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:02.383531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b8edf-d8f7-4458-a8f0-b7d074ccc968 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.396579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:02.417363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.418535 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.418535 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.418719 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.419275 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] RBAC: Adding query filter params (name=image) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:02.419586 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.421077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.431254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 531/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:02.432494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:02.461761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:02.545991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13593ba3-74b9-4dbf-b75c-df524acd0edb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.579502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.580165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.580476 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.581284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.581991 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:02.582301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.583674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845bfda-bd6a-4d64-9f20-ba96628eb7c9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.588682 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 527/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:02.594343 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:02.698270 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a1a2-b885-4486-a7b6-5fa781420b9f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:02.732935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:02.733598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:02.733883 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:02.734164 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:02.734916 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:02.736285 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c5ef0-6139-4a66-8ff7-f1b8d8f92335 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:02.810287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 532/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:47:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:03.751708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8b06-33ae-493f-9386-896c6629911f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:03.752281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8b06-33ae-493f-9386-896c6629911f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:03.752281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de8b06-33ae-493f-9386-896c6629911f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:03.753882 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 528/1060] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:03.758919 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:03.759315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:03.759484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:03.776214 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:03.777461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:03.804060 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:03.850921 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 533/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:03.874344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de8b06-33ae-493f-9386-896c6629911f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:03.970784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:03.984375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de8b06-33ae-493f-9386-896c6629911f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.020466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.021200 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.021492 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.021773 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.032017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:04.041015 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:04.041941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:04.042941 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 529/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:47:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:04.048442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.149628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83a707-b730-411d-a510-cd1e8f4566b0 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.183758 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.184454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.185042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.185803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:04.186122 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.187510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198fc51-aec6-4850-98a5-e2ba3f330c0e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.200280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 534/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:04.201705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.248688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2233-0158-4cc1-9f61-f67681043cec None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.249258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2233-0158-4cc1-9f61-f67681043cec None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.249522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2233-0158-4cc1-9f61-f67681043cec None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.251173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 535/1064] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:04.255970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.256266 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.256584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.274130 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:04.275233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:04.290286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.311610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f299c3-49b8-415b-b6c8-e948b10abe1d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.347139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 536/1065] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:47:04.350705 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.351699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.352000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.352284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.363328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.364832 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.370174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.374379 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:04.384171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:04.391744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 530/1066] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:04.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.480798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fc744-5798-4422-914a-de93e2a6823a None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.496601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9e7b5-f4f9-411e-9a6a-dc5dc0305bf4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.518269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.519573 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.519865 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.520148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.532105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:04.532651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.533320 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.533607 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.533922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.534645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:04.534955 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.536325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:04.540332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:04.541367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:04.547340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:04.548044 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.552687 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:04.554809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.565801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.629046 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.663252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4a31a-5373-41d2-a6a3-4faf9d7e69bc None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.674459 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7573ec-9f62-4416-8e8d-dacbaeb98525 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.697348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.698021 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.698309 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.698590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.699340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:04.699657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.701080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.714433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 538/1069] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:04.714599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.714599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.714599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.714599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.715411 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.721378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.722822 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:47:04.738225 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:04.739209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:04.740165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 532/1070] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:04.745325 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.792343 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.823727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b8a79-de6a-4502-8865-d4565bfe566a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.850468 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf9389-03be-412e-888c-e267fbb79c99 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:04.879497 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:04.898609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.899104 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:04.899299 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.899594 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.899881 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.899978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.900254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.900570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] PATH_INFO: `/v3/users/702be352a0d5464dbbd6f725ffaf76b4` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.900782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:04.901101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.901775 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=702be352a0d5464dbbd6f725ffaf76b4)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:04.902562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640a84d-9d9a-422a-8c81-4e8b987bd797 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.903256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e71a9d-c812-42b5-96b8-01d0ec17bcc2 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:04.905086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 539/1071] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/users/702be352a0d5464dbbd6f725ffaf76b4 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:04.906140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c610-0cce-4a8f-a6f3-210c31f306a5 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.906398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c610-0cce-4a8f-a6f3-210c31f306a5 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.906678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c610-0cce-4a8f-a6f3-210c31f306a5 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.908144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 540/1072] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:04.911094 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c610-0cce-4a8f-a6f3-210c31f306a5 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:04.923395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 533/1073] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:04.925473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6743-417b-4880-b136-c29464378cda None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:04.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6743-417b-4880-b136-c29464378cda None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:04.926434 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd6743-417b-4880-b136-c29464378cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:04.942689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-58fd6743-417b-4880-b136-c29464378cda None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:04.943877 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-58fd6743-417b-4880-b136-c29464378cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:05.009330 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 534/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:05.010136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd6743-417b-4880-b136-c29464378cda None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.017325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c610-0cce-4a8f-a6f3-210c31f306a5 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.051581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.052466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.052759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.053041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.054243 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.055681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.062177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 541/1075] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:04 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:05.062177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.068877 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.115124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd6743-417b-4880-b136-c29464378cda None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.124355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.148677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.149747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.149747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.150029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.157989 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e685fc-16b1-4dc1-b45e-5b7bae4f2a57 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.160858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.162306 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:05.180124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:05.181140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:05.182056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:05.182056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:05.182056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:05.182056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:05.182056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 535/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:05.182348 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.195870 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.196561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.196849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.197127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.265024 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.266482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.276263 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.283077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0d159-87f1-4737-9a07-311cdaf2cabc None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.319322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.320243 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.320577 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.320875 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e/users/702be352a0d5464dbbd6f725ffaf76b4/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.322973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f78d621b954d4c80d4003f9d91ff9e, user_id=702be352a0d5464dbbd6f725ffaf76b4, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.324490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.373738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 542/1077] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:05.374829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.420226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:47:05 2022] PUT /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e/users/702be352a0d5464dbbd6f725ffaf76b4/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:47:05.421092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.446662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.481267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb2703-d925-4586-adf3-957add260f3b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.493106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.521167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.524397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.524397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.524397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.524397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:05.524397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.525540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.538670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892931a-14be-45ab-a99a-66168ad8c856 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.544291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 543/1079] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:05.545367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.582677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.584683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.584683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.584683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.597923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.599388 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:05.621059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:05.622305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:05.623569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:05.623569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:05.623569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:05.623569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:05.624717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 537/1080] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:05.630486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.665958 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e96da-933d-43ca-9cec-1af0b25efd02 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.704359 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.705389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.706166 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.706376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.709062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.714637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.716110 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:47:05.731575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:05.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:05.735271 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 544/1081] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:05.739225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:05.741161 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbca230-08df-411f-bab0-b2fd60f465f0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.769606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:05.779961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.781731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.781731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.781731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.781998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:05.782242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.783615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.797224 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 538/1082] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:05.855723 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c845f907-af22-4d24-820d-c157b3e5c633 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:05.917488 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:05.918174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:05.918461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:05.918743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:05.919550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:05.919864 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:05.921350 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911c6f6-8d9b-439e-9097-71961176f376 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:05.939363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 545/1083] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:47:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:05.941254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:06.048521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68800f-aad4-4ec9-91b7-28fea15559db None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:06.080002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:06.085993 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:06.086896 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:06.087183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:06.087465 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/1a8bd9a6897f4b6097422675238001ea` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:06.089744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=8282dd1579c749378efdccf403a539c4, role_id=1a8bd9a6897f4b6097422675238001ea)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:06.096559 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3d171-0464-4f3d-a110-e54c4f77d25a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:06.205523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 539/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:47:05 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/8282dd1579c749378efdccf403a539c4/roles/1a8bd9a6897f4b6097422675238001ea => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:47:07.478504 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd1e8-1d96-4c79-9bca-d019470f4e2e None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:07.479063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd1e8-1d96-4c79-9bca-d019470f4e2e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:07.479063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bd1e8-1d96-4c79-9bca-d019470f4e2e None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:07.480628 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 546/1085] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:07.486062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:07.486458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:07.486639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:07.503802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:07.505152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:07.570080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 540/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:07.594144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd1e8-1d96-4c79-9bca-d019470f4e2e None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:07.682891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:07.701720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bd1e8-1d96-4c79-9bca-d019470f4e2e None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:07.736050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:07.736819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:07.737644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:07.737934 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:07.747971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:07.756479 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:07.757453 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:07.758316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:07.763723 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:07.862614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d165846-999e-4585-ae7f-73ab80882871 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:07.886152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:07.898292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:07.898976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:07.899268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:07.899557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:07.900316 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:07.900681 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:07.902079 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:07.911288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 541/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:07.917129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.015875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a386ba9-1135-4d85-9ba2-13ae3bc22c37 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.047961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.048875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.049167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.049963 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] PATH_INFO: `/v3/users/702be352a0d5464dbbd6f725ffaf76b4` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.051148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] RBAC: Authorizing `identity:get_user(user_id=702be352a0d5464dbbd6f725ffaf76b4)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.052611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ec7f6-cbce-4003-b281-8112d23ce7ab None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.054254 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 548/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:07 2022] GET /identity/v3/users/702be352a0d5464dbbd6f725ffaf76b4 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:08.060118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.160117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83e19-8e33-4784-957a-cef9fe75d359 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.193902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.194563 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.194856 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.195142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.209403 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622244-7126-4ec0-ab29-ea7eb904f1bb None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.209727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622244-7126-4ec0-ab29-ea7eb904f1bb None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.210025 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd622244-7126-4ec0-ab29-ea7eb904f1bb None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.211597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 549/1090] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:47:08.216533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.216829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.217560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.234435 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:08.235667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:08.247071 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.249647 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.264613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.266126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.304842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 550/1091] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 22:47:08.328374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.365378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 542/1092] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:08.371028 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.429099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97a58-7229-4d3e-9ae6-19c2cd29df95 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.452954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.463010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.463822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.464114 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.464416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.469110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321ef15-bbcb-49ab-b4ff-f8f0543f6e66 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.475923 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:08.484163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:08.485688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:08.486539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 551/1093] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:47:08.491463 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.500681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.506812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.507763 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.508053 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.508341 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.514352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.514352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.514352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 543/1094] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:08.519528 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.595707 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895941-9f09-49ac-b5da-bb232f5ed7d7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.619429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3dda6-3b41-4922-b707-2b0ad053e840 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.629784 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.630461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.630753 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.631043 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.631808 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:08.632124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.633550 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.641469 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 552/1095] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:08.647560 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.653189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.653841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.654126 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.654403 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.655230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=51f78d621b954d4c80d4003f9d91ff9e, user.id=702be352a0d5464dbbd6f725ffaf76b4) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:08.655545 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.657007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.676431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 544/1096] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/role_assignments?user.id=702be352a0d5464dbbd6f725ffaf76b4&scope.project.id=51f78d621b954d4c80d4003f9d91ff9e&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:08.716666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.754088 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96996af-de47-460a-9441-15b274ef4070 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.790930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.791666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.791960 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.792246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.804824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.806301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:08.824120 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:08.825129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:08.826037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:08.826037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:08.826037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:08.826037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:08.826037 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 553/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:08.831708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:08.851035 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:08.940805 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c99-daca-4567-99e8-c3eb9d7fa06d None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:08.975180 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:08.975846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:08.976135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:08.976512 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:08.977238 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:08.977551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:08.978927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:08.990201 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 545/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:08.995807 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:09.095251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2ec47-f387-4f7d-b7e8-1241c268ca78 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:09.114591 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:09.129340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:09.130139 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:09.130431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:09.130717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] PATH_INFO: `/v3/users/nova` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:09.138196 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:09.139640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:47:09.154490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:09.155653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:09.156665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 554/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 22:47:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:09.161659 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:09.238309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:09.261106 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343043cb-fbeb-4ccd-a457-2842c47e2f32 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:09.294002 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:09.294670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:09.294959 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:09.295241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:09.296083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:09.296420 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:09.297861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:09.314988 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 546/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 22:47:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:09.321369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:09.419893 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1eb411-68f6-4bc3-ac78-2659ee681fec None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:09.453127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:09.453776 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:09.454062 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:09.454344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:09.501041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:09.520540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:09.521993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:09.616603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 555/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:09.622817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:09.719968 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ba57d-03ce-4bfb-8afb-36e4b979b174 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:09.754735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:09.755532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:09.755823 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:09.756109 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:09.758075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:09.766840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:09.775226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:09.787218 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:09.788315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:09.789347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:47:09.789347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:09.789347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:47:09.789347 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:09.792623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 547/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:09.794279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:09.884072 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:09.903293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436ed18-3406-45b4-9727-1b822d7e2469 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:09.938316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:09.938991 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:09.939285 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:09.939574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:09.940305 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:09.940656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:09.942041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:09.953248 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 556/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:09.959691 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:10.056824 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddfb9c-0079-44e1-a25f-33c540923335 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:10.089676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:10.090454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:10.090745 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:10.091029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:10.098158 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:10.099595 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:47:10.113051 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:10.114117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:10.115101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 548/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:47:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:10.120045 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:10.220486 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27e14fd-350d-4898-bc02-a797fad786bf None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:10.254066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:10.254734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:10.255028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:10.255315 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:10.256111 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:10.256450 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:10.257894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b0f13-338e-49b2-ad8d-dba743469d29 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:10.266941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:10.270943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 557/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:47:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:10.277264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:10.323816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:10.378264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803f186-307d-4337-9760-6dd3a20bba98 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:10.411205 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:10.411865 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:10.412155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:10.412467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:10.413308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] RBAC: Adding query filter params (role.id=1a8bd9a6897f4b6097422675238001ea, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=8282dd1579c749378efdccf403a539c4) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:10.413626 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:10.415059 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4e1a-969a-44c7-bb16-4c4400db3ecb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:10.421153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 549/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:10 2022] GET /identity/v3/role_assignments?user.id=8282dd1579c749378efdccf403a539c4&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=1a8bd9a6897f4b6097422675238001ea => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:10.753390 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31028-eaa7-4363-9e60-eb62314e68b1 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:10.753881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31028-eaa7-4363-9e60-eb62314e68b1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:10.753881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb31028-eaa7-4363-9e60-eb62314e68b1 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:10.755306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 558/1107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:10.760777 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:10.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:10.761350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:10.778079 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:10.779278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:10.849766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 550/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:10.875086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31028-eaa7-4363-9e60-eb62314e68b1 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:10.981884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb31028-eaa7-4363-9e60-eb62314e68b1 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:11.019177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:11.019912 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:11.020209 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:11.020553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:11.021761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:11.023211 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54652183-c0cc-415b-b044-6b4a3d3746ea None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:11.024893 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 559/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:11.030775 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:11.073809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:11.133542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf8ceec-5da4-4d67-9f1d-6d48f1ecf040 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:11.167368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:11.168054 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:11.168340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:11.168645 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:11.169365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:11.170825 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b6702-fec9-4aa4-be1b-6be7f425afdc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:11.251692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 551/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:47:11 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:13.308766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a834-932a-43a9-aa1b-920960e86ee2 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:13.309277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a834-932a-43a9-aa1b-920960e86ee2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:13.309277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360a834-932a-43a9-aa1b-920960e86ee2 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:13.310607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 560/1111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:13.316331 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:13.316796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:13.316898 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:13.333950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:13.335136 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:13.400536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 552/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:13.424144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a834-932a-43a9-aa1b-920960e86ee2 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:13.489709 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:13.523100 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360a834-932a-43a9-aa1b-920960e86ee2 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:13.555796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:13.556698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:13.556993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:13.557283 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] PATH_INFO: `/v3/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:13.558822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] RBAC: Authorizing `identity:get_role(role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:13.560151 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:13.561568 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 561/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:13 2022] GET /identity/v3/roles/e9022c4cbdb242c5a305800f427de25b => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:13.567981 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:13.600539 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:13.672283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806785c-75db-48cd-af62-a0f2fbbb87f0 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:13.705139 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:13.706006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:13.706890 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:13.707172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] PATH_INFO: `/v3/users/2558de20d2b045b7aaff1c634e8a9292` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:13.719874 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] RBAC: Authorizing `identity:get_user(user_id=2558de20d2b045b7aaff1c634e8a9292)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:13.721356 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:13.723023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 553/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:13 2022] GET /identity/v3/users/2558de20d2b045b7aaff1c634e8a9292 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:13.728720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:13.825690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814187b-e356-4e19-83cd-8b84b4d33f7b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:13.859320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:13.859973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:13.860357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:13.860357 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:13.864741 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:13.928715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:13.930189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:14.026251 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 562/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:14.032326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:14.115716 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:14.131176 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61815506-facd-490d-8ad1-9c25414e27ce None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:14.164957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:14.165850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:14.166133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:14.166412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:14.167578 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:14.169031 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c99c2-f2fe-4f87-8ee8-74437537a03b None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:14.170766 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 554/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:14 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:14.177397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:14.211727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:14.274189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d915a-508c-4785-b2a1-5a18045d8b82 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:14.307597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:14.308245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:14.308574 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:14.308859 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:14.309689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=51f78d621b954d4c80d4003f9d91ff9e, user.id=2558de20d2b045b7aaff1c634e8a9292) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:14.310005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:14.311428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73ea7a-9d2d-4bcc-be0b-1c547c85431a None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:14.316806 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 563/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:14 2022] GET /identity/v3/role_assignments?user.id=2558de20d2b045b7aaff1c634e8a9292&scope.project.id=51f78d621b954d4c80d4003f9d91ff9e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:16.317378 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4c2d-a9ff-4892-b8ae-691091fc35a3 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.317885 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4c2d-a9ff-4892-b8ae-691091fc35a3 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.318004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b4c2d-a9ff-4892-b8ae-691091fc35a3 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.319309 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 555/1118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:16.324622 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.324992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.325191 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.341640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:16.342821 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:16.407818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 564/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:16.431661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4c2d-a9ff-4892-b8ae-691091fc35a3 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:16.529943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b4c2d-a9ff-4892-b8ae-691091fc35a3 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:16.562961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:16.563808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.564091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.564367 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] PATH_INFO: `/v3/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.565882 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] RBAC: Authorizing `identity:get_role(role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:16.567250 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:16.568686 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 556/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:16 2022] GET /identity/v3/roles/e9022c4cbdb242c5a305800f427de25b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:16.574314 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:16.603516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:16.671118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbae1c-3bcf-4b4c-bd33-35c4b5a5a32c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:16.704340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:16.705241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.705534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.705823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] PATH_INFO: `/v3/users/2558de20d2b045b7aaff1c634e8a9292` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.707525 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] RBAC: Authorizing `identity:get_user(user_id=2558de20d2b045b7aaff1c634e8a9292)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:16.708999 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:16.710658 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 565/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:16 2022] GET /identity/v3/users/2558de20d2b045b7aaff1c634e8a9292 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:16.716272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:16.737923 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:16.813989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031ee05-88ad-40b1-9152-428f4701da93 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:16.848146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:16.848982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.849274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.849558 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.850741 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:16.852169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf64df2-9df3-467f-8357-c8873c268fca None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:16.853904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 557/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:16 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:16.859683 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:16.952953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:16.957189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9fee-9cd8-4d0a-a66c-1526d2f411e7 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:16.990101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:16.990986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:16.991277 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:16.991563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e/users/2558de20d2b045b7aaff1c634e8a9292/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:16.993801 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] RBAC: Authorizing `identity:create_grant(project_id=51f78d621b954d4c80d4003f9d91ff9e, user_id=2558de20d2b045b7aaff1c634e8a9292, role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:16.995238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf50a4b-a390-4ced-83b4-f1ed75471763 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:17.068105 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 566/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:47:16 2022] PUT /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e/users/2558de20d2b045b7aaff1c634e8a9292/roles/e9022c4cbdb242c5a305800f427de25b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:47:19.071812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b03ba-e5db-4034-9994-4e7b43d2abb4 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.072353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b03ba-e5db-4034-9994-4e7b43d2abb4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.072353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b03ba-e5db-4034-9994-4e7b43d2abb4 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.073797 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 558/1124] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:47:19.078899 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.079274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.079467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.095787 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:19.097080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:19.162110 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 567/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:19.185692 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b03ba-e5db-4034-9994-4e7b43d2abb4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:19.272717 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:19.285001 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b03ba-e5db-4034-9994-4e7b43d2abb4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:19.318669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:19.319519 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.319809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.320091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] PATH_INFO: `/v3/roles/e9022c4cbdb242c5a305800f427de25b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.321601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] RBAC: Authorizing `identity:get_role(role_id=e9022c4cbdb242c5a305800f427de25b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:19.322979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:19.324349 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 559/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:19 2022] GET /identity/v3/roles/e9022c4cbdb242c5a305800f427de25b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:19.330124 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:19.415505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:19.427394 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1935f14-577c-432d-8b97-4ac3d65cf228 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:19.460710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:19.461572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.461858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.462137 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] PATH_INFO: `/v3/users/2558de20d2b045b7aaff1c634e8a9292` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.463328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] RBAC: Authorizing `identity:get_user(user_id=2558de20d2b045b7aaff1c634e8a9292)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:19.464788 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:19.466398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 568/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:19 2022] GET /identity/v3/users/2558de20d2b045b7aaff1c634e8a9292 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:19.472638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:19.569118 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23923-488f-45b2-a5ae-3633a5ad66aa None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:19.602643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:19.603285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.603573 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.603852 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.628251 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:19.669855 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:19.671252 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:19.766133 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 560/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:19.772564 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:19.867644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870c222-4f1e-4b37-90e2-0f3a11645cef None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:19.901169 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:19.902028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:19.902316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:19.902592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] PATH_INFO: `/v3/projects/51f78d621b954d4c80d4003f9d91ff9e` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:19.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] RBAC: Authorizing `identity:get_project(project_id=51f78d621b954d4c80d4003f9d91ff9e)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:19.905213 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2456a-86e2-4541-93d3-fefa083b2323 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:19.906886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 569/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:19 2022] GET /identity/v3/projects/51f78d621b954d4c80d4003f9d91ff9e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:19.913517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:19.967526 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:20.010144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf993e-f907-4b00-a7a5-e4323cec31d9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:20.043029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:20.043678 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:20.043966 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:20.044247 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:20.045102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] RBAC: Adding query filter params (role.id=e9022c4cbdb242c5a305800f427de25b, scope.project.id=51f78d621b954d4c80d4003f9d91ff9e, user.id=2558de20d2b045b7aaff1c634e8a9292) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:20.045423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:20.046848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d84434e-7103-4f9d-8760-a29d3452d2d0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:20.052600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 561/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:19 2022] GET /identity/v3/role_assignments?user.id=2558de20d2b045b7aaff1c634e8a9292&scope.project.id=51f78d621b954d4c80d4003f9d91ff9e&role.id=e9022c4cbdb242c5a305800f427de25b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:22.077400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc81ca-85f8-4f83-b036-f2b4ee5aecb0 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:22.077928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc81ca-85f8-4f83-b036-f2b4ee5aecb0 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:22.078030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc81ca-85f8-4f83-b036-f2b4ee5aecb0 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:22.079344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 570/1131] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:22.084670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:22.085108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:22.085244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:22.101801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:22.103010 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:22.168706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 562/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:22.193379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc81ca-85f8-4f83-b036-f2b4ee5aecb0 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:22.217919 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:22.291993 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc81ca-85f8-4f83-b036-f2b4ee5aecb0 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:22.325432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:22.326216 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:22.326508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:22.326793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:22.327963 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:22.329416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a352c-9870-473a-9431-fc4696599bf6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:22.331215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 571/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:22.336829 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:22.390262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:22.439459 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32562e79-dab8-4bba-ac6f-bcd5d2f9adb2 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:22.472448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:22.473102 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:22.473392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:22.473675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:22.474381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:22.475820 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec24c0e-09cc-4600-9418-1b3a70801c63 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:22.566241 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 563/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:47:22 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:24.613063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da50f0-a0e0-4ead-a90b-a109be297833 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:24.613609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da50f0-a0e0-4ead-a90b-a109be297833 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:24.613609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da50f0-a0e0-4ead-a90b-a109be297833 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:24.615009 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 572/1135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:24.620274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:24.620683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:24.620878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:24.637962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:24.639143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:24.704123 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 564/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:24.729176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da50f0-a0e0-4ead-a90b-a109be297833 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:24.819752 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:24.829140 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da50f0-a0e0-4ead-a90b-a109be297833 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:24.862580 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:24.863413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:24.863657 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:24.863942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:24.865134 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:24.866565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387c3352-7c9c-430d-8f1c-abf427a705ca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:24.868173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 573/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:47:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:24.874090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:24.905489 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:24.971920 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b7f2c-7d0f-487d-b69b-940d8f9626c4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:25.006198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:25.006863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:25.007148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:25.007428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:25.008195 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:25.009672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453aeb98-d068-4374-909a-bd03cd89b8cc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:25.113779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 565/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:47:24 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:27.174590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d0437-c6b6-4fd3-8386-b7ef5416a481 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.175097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d0437-c6b6-4fd3-8386-b7ef5416a481 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.175097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d0437-c6b6-4fd3-8386-b7ef5416a481 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.176575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 574/1139] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:27.181747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.182152 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.182315 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.199248 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:27.200446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:27.265622 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 566/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:27.288562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d0437-c6b6-4fd3-8386-b7ef5416a481 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:27.386712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d0437-c6b6-4fd3-8386-b7ef5416a481 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:27.420113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:27.420949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.421262 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.421542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.431414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:27.438990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:27.439922 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:27.440840 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 575/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:27.445976 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:27.464155 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:27.542270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e4f0a-ee43-4906-875e-75d8ee2d4fc6 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:27.575239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:27.575908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.576198 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.576514 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.577262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:27.577577 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:27.578952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:27.587517 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 567/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:27.593304 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:27.615142 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:27.690795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478f5b-4be9-485e-9002-674ecb7f591e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:27.723822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:27.724718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.725010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.725290 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] PATH_INFO: `/v3/users/24658e9a72294188821e43e30b479dd8` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.738722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] RBAC: Authorizing `identity:get_user(user_id=24658e9a72294188821e43e30b479dd8)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:27.740152 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:27.741824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 576/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:27 2022] GET /identity/v3/users/24658e9a72294188821e43e30b479dd8 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:27.747560 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:27.827552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:27.846619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d6f94-dc12-462a-84de-64b8801a421c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:27.880911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:27.881567 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:27.881867 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:27.882138 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:27.950617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:27.952023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:28.029828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:28.048470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 568/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:28.054964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:28.131917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:28.152416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7187-ddba-414b-94df-8bd720e27095 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:28.185572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:28.186433 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:28.186718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:28.186997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] PATH_INFO: `/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:28.188184 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] RBAC: Authorizing `identity:get_project(project_id=e02b631bd13a432b8a1dbf5b3edc829b)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:28.189650 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee979273-95f2-43f7-8ebb-90b006ca70d3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:28.191955 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 577/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:28 2022] GET /identity/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:28.198087 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:28.296657 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180caba8-1efd-4ddd-8247-53fa8858a9a4 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:28.330079 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:28.330721 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:28.331005 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:28.331286 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:28.332112 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=e02b631bd13a432b8a1dbf5b3edc829b, user.id=24658e9a72294188821e43e30b479dd8) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:28.332451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:28.333884 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8b62d-4e2f-4e98-9221-dcda5c4758a0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:28.339203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 569/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:28 2022] GET /identity/v3/role_assignments?user.id=24658e9a72294188821e43e30b479dd8&scope.project.id=e02b631bd13a432b8a1dbf5b3edc829b&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:30.322526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672757-c375-4225-b10e-7d61e20c606f None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:30.323050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672757-c375-4225-b10e-7d61e20c606f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:30.323144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c672757-c375-4225-b10e-7d61e20c606f None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:30.324490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 578/1147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:30.329833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:30.330257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:30.330402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:30.346995 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:30.348196 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:30.388262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:30.413390 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 570/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:30.436340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672757-c375-4225-b10e-7d61e20c606f None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:30.535485 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c672757-c375-4225-b10e-7d61e20c606f None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:30.568571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:30.569347 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:30.569632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:30.569910 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:30.579739 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:30.587269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:30.588383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:30.589358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 579/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:30.594436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:30.697128 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3785c3b-d5c8-42c4-b231-308e345b6acb None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:30.730307 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:30.730972 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:30.731264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:30.731548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:30.732293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:30.732633 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:30.734016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:30.742541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 571/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:30.748225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:30.757848 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:30.846077 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a0be-8047-405a-bb1b-634b75f1f38a None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:30.879339 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:30.880193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:30.880514 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:30.880790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] PATH_INFO: `/v3/users/24658e9a72294188821e43e30b479dd8` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:30.881983 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] RBAC: Authorizing `identity:get_user(user_id=24658e9a72294188821e43e30b479dd8)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:30.883420 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:30.885097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 580/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:30 2022] GET /identity/v3/users/24658e9a72294188821e43e30b479dd8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:30.890735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:30.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:30.990352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c48825-eb64-4573-9d44-55cf31065cba None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:31.024213 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:31.025099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:31.025394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:31.025677 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] PATH_INFO: `/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:31.026863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] RBAC: Authorizing `identity:get_project(project_id=e02b631bd13a432b8a1dbf5b3edc829b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:31.028297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da050cb-e9f1-41b9-b64c-eeefca94eddc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:31.030018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 572/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:30 2022] GET /identity/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:31.036513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:31.109186 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:31.132824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ceb03-85e2-4d5d-aece-e7748be9a87c None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:31.166222 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:31.167097 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:31.167386 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:31.167667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] PATH_INFO: `/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b/users/24658e9a72294188821e43e30b479dd8/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:31.169618 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] RBAC: Authorizing `identity:create_grant(project_id=e02b631bd13a432b8a1dbf5b3edc829b, user_id=24658e9a72294188821e43e30b479dd8, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:31.171042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba68489-6f56-4f95-9f64-8dd544dc3abc None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:31.272028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 581/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:47:31 2022] PUT /identity/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b/users/24658e9a72294188821e43e30b479dd8/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:47:33.267722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6b8a-4a95-4c35-9ec6-d8cd0b7ff3cd None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.268220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6b8a-4a95-4c35-9ec6-d8cd0b7ff3cd None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.268220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6b8a-4a95-4c35-9ec6-d8cd0b7ff3cd None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:33.269684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 573/1154] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:33.274971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.275413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.275516 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:33.291892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:33.293125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:33.356984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 582/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:33.381386 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c6b8a-4a95-4c35-9ec6-d8cd0b7ff3cd None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:33.479314 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c6b8a-4a95-4c35-9ec6-d8cd0b7ff3cd None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:33.481614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:33.512863 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:33.513646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.513933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.514215 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:33.524081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:33.532099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:33.533273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:33.534406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 574/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:33.539519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:33.599501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:33.637303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f85201-fadc-439c-abb6-3be364dff072 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:33.670389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:33.671050 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.671337 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.671617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:33.672361 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:33.672814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:33.674204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:33.682697 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 583/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:33.688293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:33.787189 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d58c19-1e9a-4e54-a4e8-b7810a837234 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:33.819920 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:33.820814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.821097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.821375 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] PATH_INFO: `/v3/users/24658e9a72294188821e43e30b479dd8` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:33.822554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=24658e9a72294188821e43e30b479dd8)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:33.823984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:33.825646 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 575/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:33 2022] GET /identity/v3/users/24658e9a72294188821e43e30b479dd8 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:33.831414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:33.930935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b66308-d70f-4c6d-8510-4dd9e55c2e4f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:33.954970 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:33.963951 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:33.964635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:33.964920 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:33.966258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:34.030322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:34.031755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:34.125987 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 584/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:34.131916 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:34.163621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:34.231122 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ef9ec-94df-4a73-b37e-e3c0a7918fc6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:34.264103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:34.264983 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:34.265274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:34.265557 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] PATH_INFO: `/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:34.266742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] RBAC: Authorizing `identity:get_project(project_id=e02b631bd13a432b8a1dbf5b3edc829b)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:34.268184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4395b7-1a1f-405f-b57f-a6fbb2947442 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:34.270436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 576/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:34 2022] GET /identity/v3/projects/e02b631bd13a432b8a1dbf5b3edc829b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:34.276426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:34.302725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:34.373832 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58eddf7-b2c9-450a-a276-55915af83515 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:34.407693 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:34.408280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:34.408597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:34.408879 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:34.409704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=e02b631bd13a432b8a1dbf5b3edc829b, user.id=24658e9a72294188821e43e30b479dd8) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:34.410017 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:34.411440 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e64dd-b172-4705-bf4e-9bacef54138e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:34.417143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 585/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:34 2022] GET /identity/v3/role_assignments?user.id=24658e9a72294188821e43e30b479dd8&scope.project.id=e02b631bd13a432b8a1dbf5b3edc829b&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:36.472755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d03dd-5a6c-4b56-aa79-f72d8642598e None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:36.473385 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d03dd-5a6c-4b56-aa79-f72d8642598e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:36.473385 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d03dd-5a6c-4b56-aa79-f72d8642598e None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:36.474690 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 577/1162] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:36.479849 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:36.480237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:36.480454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:36.496990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:36.498215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:36.564329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 586/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:36.587788 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d03dd-5a6c-4b56-aa79-f72d8642598e None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:36.682660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:36.686426 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d03dd-5a6c-4b56-aa79-f72d8642598e None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:36.719999 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:36.720676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:36.720968 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:36.721253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:36.787944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:36.789355 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:36.883878 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:36.886076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 578/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:36.893063 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:36.914019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:36.989936 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8e804-60ad-4b6f-a558-d11690daee73 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:37.023856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:37.024686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:37.024978 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:37.025263 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:37.031858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:37.033336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-f55f89bf-2a5b-43cc-84d3-bd37c3b193ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:37.047904 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:37.049255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:37.050473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 587/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:47:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:37.055029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:37.151966 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97375a-821c-43e9-9f46-cc5d20c6aa86 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:37.185394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:37.186046 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:37.186333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:37.186616 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:37.187341 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:37.187655 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:37.189064 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1db7-27a9-41eb-95df-d48c9ebcb2a1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:37.196237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 579/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 22:47:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:47:39.228342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60280c-73dc-4c19-bbae-5548ec778aad None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:39.228896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60280c-73dc-4c19-bbae-5548ec778aad None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:39.228896 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60280c-73dc-4c19-bbae-5548ec778aad None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:39.230245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 588/1167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:39.235525 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3c6c-099f-41a9-ba32-7667138af616 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:39.235945 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3c6c-099f-41a9-ba32-7667138af616 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:39.236091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a3c6c-099f-41a9-ba32-7667138af616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:39.254568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e08a3c6c-099f-41a9-ba32-7667138af616 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:39.255741 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e08a3c6c-099f-41a9-ba32-7667138af616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:39.311003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:39.319520 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 580/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:39.342102 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60280c-73dc-4c19-bbae-5548ec778aad None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:39.422335 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:39.442173 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60280c-73dc-4c19-bbae-5548ec778aad None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:39.474592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:39.475242 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:39.475531 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:39.475814 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:39.476585 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:39.477945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a0a0-18f4-4df4-94de-085d8322f4f4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:39.537885 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 589/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Jun 29 22:47:39 2022] POST /identity/v3/domains => generated 267 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:41.585119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049793-ad96-4f58-b963-6b62650e64c6 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:41.585663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049793-ad96-4f58-b963-6b62650e64c6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:41.585663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049793-ad96-4f58-b963-6b62650e64c6 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:41.587050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 581/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:41.592278 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:41.592685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:41.592882 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:41.610010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:41.611192 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:41.676466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 590/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:41.699595 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff049793-ad96-4f58-b963-6b62650e64c6 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:41.798549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff049793-ad96-4f58-b963-6b62650e64c6 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:41.832261 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:41.833145 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:41.833431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:41.833715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] PATH_INFO: `/v3/domains/a06daf2a72c44365b46ac573cce61e56` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:41.844146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a06daf2a72c44365b46ac573cce61e56)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:41.845674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecd329-62ea-4d1a-a295-a0ace1d4f7d0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:41.847811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 582/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 22:47:41 2022] GET /identity/v3/domains/a06daf2a72c44365b46ac573cce61e56 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:41.853644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:41.921667 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:41.951766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6358e-cbad-4a3f-96d7-8d75d432bf8c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:41.984256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:41.984953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:41.985246 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:41.985533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:41.986267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:41.988336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b2ba9-5781-43de-a2d6-c5dc732347ba None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:42.108812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 591/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:47:41 2022] POST /identity/v3/projects => generated 361 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:44.148461 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd057ce-d3e0-4fa1-b4ea-962c08a89e61 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:44.148969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd057ce-d3e0-4fa1-b4ea-962c08a89e61 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:44.148969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd057ce-d3e0-4fa1-b4ea-962c08a89e61 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:44.150324 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 583/1174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:44.155503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:44.155888 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:44.156080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:44.172684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:44.173977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:44.240176 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 592/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:44.265458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd057ce-d3e0-4fa1-b4ea-962c08a89e61 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:44.320407 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:44.364833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd057ce-d3e0-4fa1-b4ea-962c08a89e61 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:44.397948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:44.398848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:44.399085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:44.399363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] PATH_INFO: `/v3/domains/a06daf2a72c44365b46ac573cce61e56` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:44.400562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a06daf2a72c44365b46ac573cce61e56)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:44.401989 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53340c-fc4c-49a3-96c1-642a8a9ae772 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:44.403591 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 584/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 22:47:44 2022] GET /identity/v3/domains/a06daf2a72c44365b46ac573cce61e56 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:44.409333 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:44.460267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:44.507620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556e2e5-e0a4-4914-b004-a246c73c4da9 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:44.540926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:44.541596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:44.541889 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:44.542177 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:44.542893 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:44.544328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae28ee5-05c7-489b-ae44-6007d0a3f75f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:44.610874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 593/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:47:44 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:47:46.679858 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a38e-9e56-494f-ba8b-0d0af674c3d4 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:46.680449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a38e-9e56-494f-ba8b-0d0af674c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:46.680449 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8a38e-9e56-494f-ba8b-0d0af674c3d4 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:46.681853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 585/1178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:46.687225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:46.687659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:46.687790 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:46.704727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:46.706510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:46.770513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 594/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:46.793643 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8a38e-9e56-494f-ba8b-0d0af674c3d4 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:46.893294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8a38e-9e56-494f-ba8b-0d0af674c3d4 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:46.915670 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:46.927293 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:46.934405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:46.934405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:46.934405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:46.938475 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:46.946744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:46.947997 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:46.949083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 586/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:46.953973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:46.992379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:47.050510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9f21-62f2-4931-89b0-cbb0a5130197 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:47.083302 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:47.083959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:47.084245 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:47.084558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:47.085306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:47.085617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:47.086973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:47.094812 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 595/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:47.101040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:47.198000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cdc227-ba40-4cf7-96a9-d055455f375a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:47.230436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:47.231290 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:47.231579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:47.231859 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] PATH_INFO: `/v3/users/2ea7ef78c509494e9ccac2caaad35398` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:47.246943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] RBAC: Authorizing `identity:get_user(user_id=2ea7ef78c509494e9ccac2caaad35398)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:47.248392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:47.250073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 587/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:47 2022] GET /identity/v3/users/2ea7ef78c509494e9ccac2caaad35398 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:47.255948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:47.351258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:47.354185 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b533bac-897a-4c0a-8af6-761fdb16403d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:47.387156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:47.387817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:47.388316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:47.388796 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:47.453945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:47.455336 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:47.547618 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:47.551119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 596/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:47.557018 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:47.600073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:47.656795 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e296ab4-5fde-4cfb-9b1b-4b3c726e2fcc None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:47.689913 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:47.690769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:47.691058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:47.691339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] PATH_INFO: `/v3/projects/ff855e8236d24217a56a7bb511afe318` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:47.692560 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] RBAC: Authorizing `identity:get_project(project_id=ff855e8236d24217a56a7bb511afe318)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:47.694009 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bc30-1100-4fb4-883d-ece222eedda4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:47.695702 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 588/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:47 2022] GET /identity/v3/projects/ff855e8236d24217a56a7bb511afe318 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:47.701625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:47.797954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57afd8-7a73-4cc4-ba3a-777b925b884e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:47.832996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:47.833639 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:47.833926 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:47.834206 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:47.835029 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=ff855e8236d24217a56a7bb511afe318, user.id=2ea7ef78c509494e9ccac2caaad35398) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:47.835341 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:47.836791 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275b1a8-8be6-46f2-85ff-b7c7f5c89e8c None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:47.842078 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 597/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:47 2022] GET /identity/v3/role_assignments?user.id=2ea7ef78c509494e9ccac2caaad35398&scope.project.id=ff855e8236d24217a56a7bb511afe318&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:49.833586 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8e3b-9f42-4cd0-a8b5-2c04c99d00ed None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:49.834143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8e3b-9f42-4cd0-a8b5-2c04c99d00ed None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:49.834143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb8e3b-9f42-4cd0-a8b5-2c04c99d00ed None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:49.835540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 589/1186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:49.840938 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:49.841327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:49.841505 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:49.857961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:49.859150 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:49.917543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:49.926125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 598/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:49.949602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb8e3b-9f42-4cd0-a8b5-2c04c99d00ed None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:50.047838 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb8e3b-9f42-4cd0-a8b5-2c04c99d00ed None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:50.057246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:50.081149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:50.081927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:50.082211 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:50.082490 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:50.092753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:50.100669 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:50.101785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:47:50.102866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 590/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:50.108074 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:50.205448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bb270-cae4-4bcf-9e79-12d62cbfdc47 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:50.239754 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:50.240441 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:50.240737 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:50.241023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:50.241777 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:50.242093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:50.243475 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:50.251729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 599/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:50.257264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:50.354066 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73900-8fe0-4ad3-9c9a-0c7ce55cfe69 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:50.386488 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:50.387335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:50.387617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:50.387895 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] PATH_INFO: `/v3/users/2ea7ef78c509494e9ccac2caaad35398` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:50.389092 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] RBAC: Authorizing `identity:get_user(user_id=2ea7ef78c509494e9ccac2caaad35398)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:50.390516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:50.392131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 591/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:50 2022] GET /identity/v3/users/2ea7ef78c509494e9ccac2caaad35398 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:50.397610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:50.456495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:50.496828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fc094-e751-4f8e-b7af-2a3cc09ea7e9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:50.529782 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:50.530634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:50.530925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:50.531218 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] PATH_INFO: `/v3/projects/ff855e8236d24217a56a7bb511afe318` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:50.532428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] RBAC: Authorizing `identity:get_project(project_id=ff855e8236d24217a56a7bb511afe318)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:50.534404 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517c18e-5082-4e9a-aa57-a6dc9dc25c58 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:50.536099 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 600/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:50 2022] GET /identity/v3/projects/ff855e8236d24217a56a7bb511afe318 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:50.542094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:50.575957 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:50.638081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d899-0dd1-413d-9cc9-d7bc98bd581a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:50.671157 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:50.672023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:50.672305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:50.672614 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] PATH_INFO: `/v3/projects/ff855e8236d24217a56a7bb511afe318/users/2ea7ef78c509494e9ccac2caaad35398/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:50.674576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] RBAC: Authorizing `identity:create_grant(project_id=ff855e8236d24217a56a7bb511afe318, user_id=2ea7ef78c509494e9ccac2caaad35398, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:50.676008 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96485-e259-47ef-987e-e047eb4e55ae None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:50.739537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 592/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:47:50 2022] PUT /identity/v3/projects/ff855e8236d24217a56a7bb511afe318/users/2ea7ef78c509494e9ccac2caaad35398/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:47:52.755700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023faa-aefa-49c9-a542-51f7cbddd762 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:52.756256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023faa-aefa-49c9-a542-51f7cbddd762 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:52.756256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98023faa-aefa-49c9-a542-51f7cbddd762 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:52.757677 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 601/1193] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:47:52.763011 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:52.763407 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:52.763575 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:52.780420 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:47:52.781617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:47:52.847483 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 593/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:47:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:47:52.870972 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023faa-aefa-49c9-a542-51f7cbddd762 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:52.972028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98023faa-aefa-49c9-a542-51f7cbddd762 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:52.994115 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:53.013490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.013490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.013490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.013490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.017114 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:47:53.025204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:47:53.026332 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:47:53.027397 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:47:53.028555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 602/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:47:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:47:53.032456 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:53.059050 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:53.130467 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb0f35-dfa0-48dd-8b24-24997609b4ab None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:53.164148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.164850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.165139 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.165421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.166169 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:53.166482 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:53.167873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:53.176120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 594/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:53.181891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:53.281370 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd59fe3-67f6-4fbc-a5b7-a3226b11a157 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:53.314363 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.315762 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.316053 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.316337 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] PATH_INFO: `/v3/users/2ea7ef78c509494e9ccac2caaad35398` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.317565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] RBAC: Authorizing `identity:get_user(user_id=2ea7ef78c509494e9ccac2caaad35398)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:53.318996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:53.320647 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 603/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 22:47:53 2022] GET /identity/v3/users/2ea7ef78c509494e9ccac2caaad35398 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:53.326287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:53.412294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:53.423725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6121d-26bd-4f9c-8b48-843d9d02f8da None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:53.457345 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.457982 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.458270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.458549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.523601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:53.525086 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:53.609279 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:53.621965 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 595/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:47:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:47:53.628728 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:53.680327 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:47:53.726432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1893d2-c524-49ec-b8a7-61c1340b4cbb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:53.759860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.760745 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.761039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.761329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] PATH_INFO: `/v3/projects/ff855e8236d24217a56a7bb511afe318` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.762519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] RBAC: Authorizing `identity:get_project(project_id=ff855e8236d24217a56a7bb511afe318)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:53.763953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a92d6b-608b-45aa-ae66-4e91ef0d7878 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:53.765681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 604/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 22:47:53 2022] GET /identity/v3/projects/ff855e8236d24217a56a7bb511afe318 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:47:53.771660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:47:53.867967 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d244-06d7-467a-9a66-22732bc57fb1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:47:53.901406 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:47:53.902062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:47:53.902346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:47:53.902623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:47:53.903454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=ff855e8236d24217a56a7bb511afe318, user.id=2ea7ef78c509494e9ccac2caaad35398) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:47:53.903769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:47:53.905231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a46e-5099-46f6-8f82-36d4c1a2b490 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:47:53.911496 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 596/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:47:53 2022] GET /identity/v3/role_assignments?user.id=2ea7ef78c509494e9ccac2caaad35398&scope.project.id=ff855e8236d24217a56a7bb511afe318&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:48:03.755724 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=40 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:48:03.908318 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=74 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:10.763083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82875-2334-4f00-be30-8dbfd65b6463 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:10.763663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82875-2334-4f00-be30-8dbfd65b6463 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:10.763663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b82875-2334-4f00-be30-8dbfd65b6463 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:10.765100 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 605/1201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:10.770419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:10.770907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:10.771010 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:10.787712 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:10.788950 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:10.854023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 597/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:10.880555 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b82875-2334-4f00-be30-8dbfd65b6463 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:10.980632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b82875-2334-4f00-be30-8dbfd65b6463 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:11.014356 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:11.015089 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:11.015382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:11.015666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:11.025604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:11.027051 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:11.044674 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:11.045765 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:11.046743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:11.046743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:11.046743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:11.046743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:11.046743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 606/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:11.052748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:11.151254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db10bb7-b042-4ae8-93f3-5230e8c76631 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:11.181088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:11.186906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:11.187571 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:11.187855 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:11.188135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:11.188890 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:11.189202 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:11.190621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59b00f-13ae-421d-a279-3288822f771e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:11.201820 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 598/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:11.207679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:11.260943 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:11.307182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7af62-d38e-4555-87e5-bcc702e12bac None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:11.339322 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:11.339999 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:11.340287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:11.340599 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:11.341306 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:11.342744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0b1c1-5b9c-4992-88af-9e44f17aebea None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:11.426556 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 607/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 22:49:11 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:49:13.516854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebe38-3e25-470c-b485-c13dd3706537 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:13.517405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebe38-3e25-470c-b485-c13dd3706537 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:13.517405 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daebe38-3e25-470c-b485-c13dd3706537 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:13.518924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 599/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:13.524935 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:13.525325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:13.525501 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:13.542189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:13.543368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:13.610316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 608/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:13.634537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebe38-3e25-470c-b485-c13dd3706537 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:13.734148 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daebe38-3e25-470c-b485-c13dd3706537 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:13.768435 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:13.769167 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:13.769454 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:13.769734 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:13.779889 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:13.787596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:13.788785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:13.789848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 600/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:49:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:13.794939 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:13.834236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:13.893930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b922db2-4dfc-4163-a4d4-cc3bbf8cd468 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:13.928590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:13.929258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:13.930371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:13.930371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:13.930583 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:13.930892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:13.932268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:13.940012 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 609/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:49:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:13.946515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:13.995513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:14.044911 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e2bc-6b01-4c68-acd3-638220809a63 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:14.078292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:14.079083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:14.079372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:14.079654 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:14.090000 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:14.091451 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:14.108427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:14.109471 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:14.110579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:14.110579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:14.110579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:14.110579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:14.110579 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 601/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:14.116113 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:14.210607 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:14.213670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b59b5-3a7e-44bb-8d2c-1b329f75d69b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:14.247349 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:14.248008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:14.248293 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:14.248602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:14.249329 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:14.249637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:14.250992 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:14.263081 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 610/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:14.268862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:14.368089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da9ba-96bf-4366-a952-be760b91db25 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:14.369742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:14.402421 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:14.403253 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:14.403546 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:14.403828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:14.411358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:14.412841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:14.427096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:14.428228 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:14.431206 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 602/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:14.434331 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:14.533374 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3235b6c-1e76-4638-a52e-76eb12dc76a3 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:14.566744 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:14.567393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:14.567678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:14.567964 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:14.569002 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:14.573035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:14.573035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:14.587985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 611/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:14.593927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:14.692233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d993c-551b-4883-a543-c11d784dedb2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:14.726322 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:14.726971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:14.727258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:14.727541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:14.757026 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:14.793711 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:14.795170 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:14.890894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 603/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:49:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:49:14.897358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:14.915950 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:15.002311 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7061-e593-4e18-ab86-aa92b1433c66 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:15.040460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:15.041276 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:15.041569 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:15.041851 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:15.052927 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:15.058407 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:15.072204 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:15.073146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:15.074041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:15.074041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:15.074041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:15.074041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:15.074041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 612/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:15.079372 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:15.140026 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:15.178700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ee61-cfa4-4828-beea-b1e64eddd196 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:15.212502 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:15.213287 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:15.213585 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:15.213867 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:15.214596 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:15.214906 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:15.216273 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:15.228041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 604/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:15.233723 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:15.303217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:15.333388 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64967f52-276c-4aca-a9f0-d68ff6dfc4fb None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:15.380030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:15.381055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:15.381320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:15.381601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:15.388616 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:15.390087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:15.405536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:15.406589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:15.412538 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 613/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:15.413089 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:15.518151 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbc9c5-ea2d-4fa9-a25d-4c4317268587 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:15.541380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:15.553439 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:15.554044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:15.554335 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:15.554617 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:15.555425 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:15.555744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:15.557213 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca2c9d-0cec-4327-86b1-a9476fea6217 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:15.568663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 605/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:15.574771 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:15.674034 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6203b-8f3e-4867-8391-3f23a204e57b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:15.702662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:15.708620 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:15.709279 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:15.709572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:15.709860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:15.710698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=35c4f702a9324765b923d4d4bf04aa17) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:15.711018 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:15.712540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5c8cf-4a5c-4ba8-a8c4-7466b207aca2 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:15.717988 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 614/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:49:15 2022] GET /identity/v3/role_assignments?user.id=35c4f702a9324765b923d4d4bf04aa17&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:17.755548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d2bb-6f0d-4f26-bf31-6950e83b490f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:17.756110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d2bb-6f0d-4f26-bf31-6950e83b490f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:17.756110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6d2bb-6f0d-4f26-bf31-6950e83b490f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:17.757551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 606/1220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:17.763090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:17.763539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:17.763670 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:17.780375 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:17.781577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:17.850119 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 615/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:17.873933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d2bb-6f0d-4f26-bf31-6950e83b490f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:17.978381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6d2bb-6f0d-4f26-bf31-6950e83b490f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.012006 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.012759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.013044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.013323 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.023268 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:18.030836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:18.031846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:18.032740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 607/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:49:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:18.039028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.136706 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d338f5f-7b58-4fc0-92e3-47c8aae8de71 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.160704 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:18.171312 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.171980 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.172268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.172593 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.173338 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] RBAC: Adding query filter params (name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:18.173645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.175013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:18.182977 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 616/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:18.188722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.236266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:18.291713 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73807-a0ac-40b2-a277-059ecca8fea9 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.325552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.326348 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.326639 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.326919 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.338230 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.339722 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:18.356787 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:18.357748 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:18.358703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:18.358703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:18.358703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:18.358703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:18.358703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 608/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:18.363898 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.464117 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f17217-855c-45d3-9f82-0744ba428449 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.497004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.497663 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.497952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.498229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.498952 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:18.499256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.500640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:18.512985 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 617/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:18.518683 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.612864 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:18.619589 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95a680e-cbc8-4d85-a907-711e857ed09f None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.654785 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.655588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.655872 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.656149 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] PATH_INFO: `/v3/users/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.663171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.664983 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:18.679368 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:18.680598 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:18.681599 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 609/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:18.686579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.733440 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:18.786914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cde1f4-ee61-4de1-beb1-bf6f468f17ce None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.820698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.821376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.821664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.821946 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.822778 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:18.823091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.824604 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:18.843015 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 618/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:18.848835 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:18.947861 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429e0f0-1e9d-4f55-a51d-71575b47a3be None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:18.981137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:18.981920 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:18.982208 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:18.982486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:18.992244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:18.993715 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:19.011419 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:19.012564 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:19.013630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:19.013630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:19.013630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:19.013630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:19.013630 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 610/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:19.018428 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:19.118011 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350a49c-ecdb-494b-9c0d-ba9af33b9155 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:19.120369 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:19.155829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:19.156465 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:19.156760 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:19.157046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:19.157769 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:19.158082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:19.159527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:19.170610 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 619/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:19.176601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:19.185227 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:19.274845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230d79-9583-4d52-b25e-18be611c1f54 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:19.307815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:19.310729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:19.310729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:19.310729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:19.315789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:19.317278 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:19.332365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:19.333394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:19.334377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:19.335016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 611/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:19.340269 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:19.439892 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ada22e-e065-4958-a6c6-454ac9c401aa None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:19.472553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:19.473215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:19.473510 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:19.473798 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:19.474708 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:19.475022 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:19.476460 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6765d92-0001-4842-9e07-3d494174d375 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:19.488344 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 620/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:19.494954 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:19.560831 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:19.594280 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42395792-e283-4624-90a8-5fcabd682709 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:19.626929 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:19.627812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] REQUEST_METHOD: `PUT` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:19.628365 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:19.628684 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/35c4f702a9324765b923d4d4bf04aa17/roles/75e56e8718a744f3859938742628d571` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:19.643124 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=35c4f702a9324765b923d4d4bf04aa17, role_id=75e56e8718a744f3859938742628d571)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:19.644625 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb327983-0732-476d-a4d8-3cb5e92b964f None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:19.720576 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 612/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:49:19 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/35c4f702a9324765b923d4d4bf04aa17/roles/75e56e8718a744f3859938742628d571 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:49:21.722900 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0753fa-86e4-4434-a9f8-7a53195b3085 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:21.723487 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0753fa-86e4-4434-a9f8-7a53195b3085 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:21.723589 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0753fa-86e4-4434-a9f8-7a53195b3085 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:21.725631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 621/1233] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:21.730880 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:21.731280 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:21.731453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:21.747813 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:21.749044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:21.815382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 613/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:21.839783 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0753fa-86e4-4434-a9f8-7a53195b3085 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:21.865786 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:21.941990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0753fa-86e4-4434-a9f8-7a53195b3085 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:21.976233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:21.977036 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:21.977328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:21.977611 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:21.987597 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:21.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:21.997090 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:21.997953 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 622/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 22:49:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:22.003553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.049759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:22.102236 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678c0b2-fbf9-40b4-a2fc-1b75fac30483 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.136542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.137213 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.137505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.137790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:22.138540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] RBAC: Adding query filter params (name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:22.138860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:22.140249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:22.148821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 614/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:22.154630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.237899 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:22.253297 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb390f-af26-4226-8c1c-0a8c1d8bfe5d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.287656 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.288500 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.288795 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.289083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:22.299226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:22.300714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:22.319237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:22.320205 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:22.321354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:22.321354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:22.321354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:22.321354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:22.321354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 623/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:22.326356 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.425234 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dd25f-5941-4e20-ba0b-d09fdc9fa137 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.434500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:22.459447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.460114 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.460420 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.460718 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:22.461443 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:22.461778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:22.463196 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:22.474633 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 615/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:22.480436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.582767 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea73dd7-589b-43a2-81fb-a9369fc1b1a0 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.616731 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.617542 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.617836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.618123 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:22.620843 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:22.625497 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:22.626928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:22.642287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:22.643236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:22.644225 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 624/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:22.649395 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.749924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d874da-243e-47ff-bbc1-ac1e4604fb32 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.786119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.787297 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.787581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.787897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:22.788779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:22.789078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:22.790505 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:22.808188 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 616/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:22.814064 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:22.913125 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c1205-02c3-4682-8167-9317697e68c8 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:22.946286 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:22.946941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:22.947229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:22.947511 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.007255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:23.013596 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.015071 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.111019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 625/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:49:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:49:23.117040 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:23.144970 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:23.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fce494-1d7d-4f5d-8807-e61aa4a29e88 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:23.250871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:23.251673 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:23.251952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:23.252231 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.262812 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.264311 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:23.282697 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:23.288370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:23.289537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:23.289537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:23.289537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:23.289537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:23.289537 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 617/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:23.290711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:23.384793 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:23.390558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193d4dd-3107-4c9a-8308-f94f65e06e90 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:23.424395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:23.425118 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:23.425414 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:23.425698 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.426424 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:23.426740 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.428168 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.439217 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 626/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:49:23.445624 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:23.523636 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:23.544476 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad79e9-89e2-40db-81ea-ae46b72b741a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:23.578078 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:23.578862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:23.579150 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:23.579432 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.586817 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.588423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:23.602220 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:23.603143 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:23.604272 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 618/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:23.609430 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:23.713690 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278e6f1-5050-4609-83d8-12b09b9e5d4b None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:23.747234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:23.747929 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:23.748207 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:23.748517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.749320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:23.750331 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.751082 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcec71-a6be-4cad-8bf6-62ce1ccc46ca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.766692 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 627/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:23.773507 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:23.875506 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eabe0f-afca-4873-87c3-68f020111325 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:23.911117 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:23.911784 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:23.912074 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:23.912373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:23.913233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] RBAC: Adding query filter params (role.id=75e56e8718a744f3859938742628d571, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=35c4f702a9324765b923d4d4bf04aa17) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:23.913594 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:23.915016 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3cda7-edcf-44ca-af64-15afebb3e146 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:23.921041 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 619/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:49:23 2022] GET /identity/v3/role_assignments?user.id=35c4f702a9324765b923d4d4bf04aa17&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=75e56e8718a744f3859938742628d571 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:26.040284 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203917-c09f-4646-84d9-1c22c95a08f7 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.040881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203917-c09f-4646-84d9-1c22c95a08f7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.040881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96203917-c09f-4646-84d9-1c22c95a08f7 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.042571 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 628/1247] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:26.048264 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.048834 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.048933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.054153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:26.067116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:26.068369 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:26.135753 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 620/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:26.159507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203917-c09f-4646-84d9-1c22c95a08f7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:26.178215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:26.262039 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96203917-c09f-4646-84d9-1c22c95a08f7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:26.296871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:26.297842 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.297997 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.298310 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.308436 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:26.316010 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:26.317005 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:26.317890 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 629/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:26.323400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:26.424720 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646ccd3-7754-4159-8f6c-1c8c4b310476 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:26.454768 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:26.460513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:26.461210 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.461486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.461769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.462553 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:26.462897 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:26.464274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:26.472804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 621/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:26.478684 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:26.558432 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:26.581387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66add8ca-d23a-4da2-9fa9-64834f927e3e None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:26.614466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:26.615264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.615551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.626391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:26.627829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:26.646662 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:26.647624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:26.648648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:26.648648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:26.648648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:26.648648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:26.648648 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 630/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:26.653807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:26.756178 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a498-c811-45eb-8c5c-795ab07a2fb5 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:26.790778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:26.791452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.791742 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.792024 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.792786 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:26.793107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:26.794485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:26.807809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 622/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:26.813533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:26.919543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ace5c-bec0-43ef-9e4a-9696a3a72c71 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:26.946295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:26.954202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:26.955083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:26.955413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:26.956654 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] PATH_INFO: `/v3/users/placement` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:26.964468 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:26.966035 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:26.980391 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:26.981523 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:26.982570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 631/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:26.987582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:27.047610 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:27.095216 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfae6a-29a3-4f5e-89e8-0ab8de6d3bbb None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:27.129620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:27.130894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:27.131179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:27.131459 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:27.132294 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:27.132640 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:27.134184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:27.151402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 623/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:27.157354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:27.259666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39bb0-e7b5-4836-9056-8031d730b176 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:27.293156 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:27.293836 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:27.294165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:27.294489 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:27.349215 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:27.361249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:27.362700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:27.457256 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 632/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:49:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:49:27.463402 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:27.565299 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ffe8-59a0-4b6c-9c5f-ebb276062f5c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:27.578377 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:27.599651 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:27.600380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:27.600732 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:27.601081 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:27.611048 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:27.612532 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:27.629901 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:27.631090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:27.632013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:27.632013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:27.632013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:27.632013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:27.632013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 624/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 22:49:27.637067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:27.725080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:27.737261 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370f1ad-00b5-434f-abbe-6c209dc12b09 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:27.771688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:27.772353 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:27.772673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:27.772957 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:27.773679 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:27.773998 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:27.775382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:27.787379 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 633/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:27.793258 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:27.897431 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986369a-e8de-48fb-90fb-1e29f2439e88 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:27.933530 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:27.934340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:27.934623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:27.934904 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] PATH_INFO: `/v3/projects/service` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:27.942310 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:27.944574 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:27.959393 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:27.960542 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:27.961486 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 625/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:27.966543 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:28.066249 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f7f6-6fc3-43c5-b8a8-66e8f87c1199 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:28.100557 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:28.101227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:28.101519 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:28.101802 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] PATH_INFO: `/v3/projects` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:28.102592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:28.102910 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:28.104429 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da60f7f-60be-4b08-b226-ac884d6ce48d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:28.116368 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 634/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:28.122408 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:28.149249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:28.221849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f6c33-6b57-4e3f-b8f7-bb752144e59c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:28.255470 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:28.256108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:28.256394 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:28.256704 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:28.257536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=35c4f702a9324765b923d4d4bf04aa17) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:28.257851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:28.259285 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c337879-fd10-4029-aae8-cc30c8ce6f18 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:28.264829 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 626/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:49:28 2022] GET /identity/v3/role_assignments?user.id=35c4f702a9324765b923d4d4bf04aa17&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:30.252439 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad338da-4c13-4029-ac34-289d18f49efc None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.253038 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad338da-4c13-4029-ac34-289d18f49efc None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.253038 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad338da-4c13-4029-ac34-289d18f49efc None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.254578 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 635/1261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:30.259794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.260200 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.260363 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.277004 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:30.278215 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:30.343887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 627/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:30.368600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad338da-4c13-4029-ac34-289d18f49efc None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:30.379941 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:30.468076 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad338da-4c13-4029-ac34-289d18f49efc None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:30.504358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:30.505132 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.505426 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.505768 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.516234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:30.524493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:30.525603 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:30.526856 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 636/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:30.532062 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:30.555088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:30.634457 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2cbb-8992-4d76-bd4d-2c39c263107c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:30.668082 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:30.668789 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.669075 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.669352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] PATH_INFO: `/v3/roles` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.670090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] RBAC: Adding query filter params (name=admin) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:30.670399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:30.671757 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:30.679609 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 628/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:30.685609 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:30.751484 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:30.784712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bbc6f-d5a4-42fa-acf8-50ce5baa7eff None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:30.818212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:30.819008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.819299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.819584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.830019 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:30.831474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:30.849631 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:30.850738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:30.851742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:30.851742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:30.851742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:30.851742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:30.851742 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 637/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:30.856744 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:30.939416 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:30.959142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa38790-ff83-4f32-9242-353759ed204c None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:30.992333 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:30.993052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:30.993341 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:30.993623 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:30.994350 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:30.994664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:30.996034 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.008033 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 629/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:31.013785 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.113526 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020052-f7a3-4a7d-bb06-503cb7de1ab6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.133241 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:31.147449 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.148252 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.148575 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.148858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.156202 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.157669 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:31.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:31.173289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:31.174458 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 638/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:31.179096 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.281080 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a9dbb-dac1-4341-b616-595120326675 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.313747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.314408 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.314693 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.314973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] PATH_INFO: `/v3/users` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.315811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:31.316125 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.317590 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.326366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:31.334615 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 630/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:31.340324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.440527 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f935d-2266-4187-b523-63fdd83dee6f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.473699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.475104 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.475393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.475676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.486295 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.487792 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:31.504949 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:31.506129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:31.507381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:31.507381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:31.507381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:31.507381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:31.507381 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 639/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:31.511927 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.617925 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ea51f-8c46-45b4-b618-f32d842669e0 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.652971 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.653667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.653970 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.654257 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.654980 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:31.655299 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.656710 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.667899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 631/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:31.673855 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.705672 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:31.775440 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94651e12-5553-4d30-9682-6cfb79a434ca None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.809274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.810065 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.810354 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.810635 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.818303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.819743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:31.833049 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:31.834174 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:31.835316 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:31.836551 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 640/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:31.840214 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:31.898611 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:31.939461 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555760c-7e29-4f92-ae46-70c954edb8e6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:31.971987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:31.972618 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:31.972908 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:31.973190 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:31.974485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:31.974801 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:31.976240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a242d-61b4-4cf9-a07a-f1bc4573dcb4 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:31.988070 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 632/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:31.994653 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:32.086945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:32.095513 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21405719-9a27-4666-83f2-bbebd51595e2 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:32.136292 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:32.137208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] REQUEST_METHOD: `PUT` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:32.137495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:32.137774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] PATH_INFO: `/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/35c4f702a9324765b923d4d4bf04aa17/roles/b88eed463b8247b6afffc5bea5cbaf61` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:32.139717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] RBAC: Authorizing `identity:create_grant(project_id=d5a745493cb642b28a3220e7c7634b76, user_id=35c4f702a9324765b923d4d4bf04aa17, role_id=b88eed463b8247b6afffc5bea5cbaf61)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:32.141189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cbfed-18e8-4f74-873a-12ef6f232580 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:32.234644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 641/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 22:49:31 2022] PUT /identity/v3/projects/d5a745493cb642b28a3220e7c7634b76/users/35c4f702a9324765b923d4d4bf04aa17/roles/b88eed463b8247b6afffc5bea5cbaf61 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 22:49:34.282023 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b44b-8441-488f-bcd2-c3c96059dffe None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:34.282540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b44b-8441-488f-bcd2-c3c96059dffe None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:34.282540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3b44b-8441-488f-bcd2-c3c96059dffe None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:34.283907 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 633/1274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:34.289764 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:34.290182 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:34.290328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:34.307554 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:34.308805 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:34.374636 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 642/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:34.399767 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3b44b-8441-488f-bcd2-c3c96059dffe None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:34.501233 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3b44b-8441-488f-bcd2-c3c96059dffe None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:34.518860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:34.535604 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:34.536894 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:34.540119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:34.540119 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:34.547358 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 22:49:34.555003 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:34.556153 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:34.561246 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 634/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 22:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:34.562415 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:34.644559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:34.662592 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ec5be-577a-488b-bf8a-69e236fbb2c7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:34.695720 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:34.696389 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:34.696712 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:34.696996 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] PATH_INFO: `/v3/roles` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:34.698002 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:34.698400 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:34.700067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:34.709868 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 643/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 22:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:34.715541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:34.814442 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb75ee-617d-4839-a816-5d3af1016998 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:34.846270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:34.847147 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:34.847480 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:34.847761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:34.858768 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:34.860239 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:34.877731 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:34.879108 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:34.880240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:34.880240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:34.880240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:34.880240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:34.880240 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 635/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:34.885001 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:34.985172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65e329-8bbc-47e3-9b54-83eb4e2abb31 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.019681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.020360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.021214 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.021503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] PATH_INFO: `/v3/domains` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.022235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:35.022548 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.023924 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:35.035816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 644/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:35.042245 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:35.073429 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:35.140555 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e125-954a-4ee3-a9ab-0b4cbb9f9941 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.174008 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.174799 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.175088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.175366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.183620 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.185181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 22:49:35.199660 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:35.200815 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:35.206809 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 636/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:35.207563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:35.211067 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:35.309903 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c4d79-71eb-4492-8624-781e589cefb6 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.342490 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.343127 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.343415 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.343697 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] PATH_INFO: `/v3/users` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.344561 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:35.344874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.346299 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:35.363558 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 645/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 22:49:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:35.369326 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:35.461500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:35.470998 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc397f2-265e-4fae-912e-d6adc02d71b1 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.504759 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.505922 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.506209 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.506489 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.571354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.572888 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:35.662340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:35.672498 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 22:49:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 22:49:35.678630 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:35.742446 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:35.781208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627442a-0075-476f-870e-1e496b2c34ae None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.815748 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.816570 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.816861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.817143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.828268 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.829735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 22:49:35.846942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:35.848068 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:35.849780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 22:49:35.849780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 22:49:35.849780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 22:49:35.849780 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:35.852584 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 646/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 22:49:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:35.856021 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:35.953816 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6569c7b2-09b1-4502-af3d-9b2d83a94299 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:35.988076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:35.988763 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:35.989058 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:35.989364 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:35.990094 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:35.990410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:35.991781 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:36.003052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 638/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 22:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:49:36.009101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:36.113219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cd79c-a672-4a64-901a-c6a61cc2784d None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:36.127273 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:36.147715 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:36.148601 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:36.149828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:36.149828 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:36.155713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:36.157238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 22:49:36.171816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:36.178530 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: ERROR keystone.server.flask.application Jun 29 22:49:36.179493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 647/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 22:49:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:36.179990 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:36.230802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:36.280522 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b76d67-42d8-412e-90e3-a9cd22a22ac6 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:36.313091 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:36.313782 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:36.314104 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:36.314388 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] PATH_INFO: `/v3/projects` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:36.315172 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:36.315485 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:36.317013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c3c0d-60cf-4209-a6b0-f7c096de0a5e None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:36.329385 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 639/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 22:49:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 22:49:36.336447 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:36.435030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515ae93-43f5-4e98-9cf0-45f1f79ccb5f None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:36.469324 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:36.469986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:36.470274 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:36.470559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:36.471393 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] RBAC: Adding query filter params (role.id=b88eed463b8247b6afffc5bea5cbaf61, scope.project.id=d5a745493cb642b28a3220e7c7634b76, user.id=35c4f702a9324765b923d4d4bf04aa17) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:36.471711 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:36.473226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc9cf3e-70ca-4d1d-94e3-162b45c2604b None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:36.479147 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 648/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 22:49:36 2022] GET /identity/v3/role_assignments?user.id=35c4f702a9324765b923d4d4bf04aa17&scope.project.id=d5a745493cb642b28a3220e7c7634b76&role.id=b88eed463b8247b6afffc5bea5cbaf61 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:38.568237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee5a9-b863-4ad4-8a55-f97ecc606fff None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:38.568807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee5a9-b863-4ad4-8a55-f97ecc606fff None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:38.568924 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee5a9-b863-4ad4-8a55-f97ecc606fff None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:38.570270 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 640/1288] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:38.575659 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:38.576031 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:38.576236 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:38.593066 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:38.595200 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:38.626117 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:38.663820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 649/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:38.687584 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee5a9-b863-4ad4-8a55-f97ecc606fff None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:38.790499 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee5a9-b863-4ad4-8a55-f97ecc606fff None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:38.801032 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:38.823769 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:38.824544 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:38.824828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:38.825101 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:38.825747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:38.827214 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:38.839203 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:38.840494 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:38.841662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 641/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:49:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:38.846360 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:38.951197 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d334-4659-4937-8185-c6daa9bc91a7 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:38.984729 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:38.985395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:38.985681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:38.985961 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:38.986668 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] RBAC: Adding query filter params (name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:38.986979 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:38.988342 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd37ff-72a7-48a9-816a-a5f78cef9883 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:38.993093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 650/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:49:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:38.998851 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:39.096790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12167e7-bc70-462b-ba4f-b59441b6a5b2 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:39.130818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:39.131479 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:39.131765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:39.132044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] PATH_INFO: `/v3/services` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:39.132794 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] RBAC: Adding query filter params (type=placement) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:39.133110 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:39.134474 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb16fe-e6e8-4e7c-8c23-89fd5eb54f8a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:39.138871 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 642/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:49:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:41.147651 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bacb6-71be-4842-8e77-417b4f138109 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:41.148235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bacb6-71be-4842-8e77-417b4f138109 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:41.148235 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84bacb6-71be-4842-8e77-417b4f138109 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:41.149532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 651/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:41.154853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da1e2-2ae0-48db-910d-2679e6a6c10c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:41.158381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da1e2-2ae0-48db-910d-2679e6a6c10c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:41.158381 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da1e2-2ae0-48db-910d-2679e6a6c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:41.172507 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-369da1e2-2ae0-48db-910d-2679e6a6c10c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:41.173703 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-369da1e2-2ae0-48db-910d-2679e6a6c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:41.202382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:41.238833 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 643/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:41.262287 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bacb6-71be-4842-8e77-417b4f138109 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:41.294183 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:41.363154 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84bacb6-71be-4842-8e77-417b4f138109 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:41.399227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:41.399227 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:41.399495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:41.399602 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:41.400303 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:41.401699 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c3d2-4d89-421f-96f1-5d1c89d7c1d4 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:41.593199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 652/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 22:49:41 2022] POST /identity/v3/services => generated 246 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:49:43.650109 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fe70f-5356-4067-9e62-b72fb0e8192f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:43.650662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fe70f-5356-4067-9e62-b72fb0e8192f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:43.650662 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fe70f-5356-4067-9e62-b72fb0e8192f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:43.652084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 644/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:43.657189 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:43.657640 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:43.657747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:43.675632 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:43.677507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:43.750491 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 653/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:43.773853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fe70f-5356-4067-9e62-b72fb0e8192f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:43.875529 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fe70f-5356-4067-9e62-b72fb0e8192f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:43.911826 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:43.912185 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:43.912506 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:43.912791 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:43.913447 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:43.914821 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:43.926515 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:43.928339 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:43.929700 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 645/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:49:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:43.934399 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:43.952534 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:44.031517 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e727f91-eef5-4ff1-9f37-2a83d53f0451 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:44.064700 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:44.065371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:44.065665 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:44.065948 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:44.066660 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:44.066973 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:44.068392 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:44.074634 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 654/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:49:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:44.080672 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:44.112860 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:44.180755 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86f4fc-62a2-4805-b069-7664cd12d5e3 None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:44.215764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:44.216433 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:44.216730 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:44.217013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:44.217802 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] RBAC: Adding query filter params (interface=public, service_id=b862d209197e4ad586f23a1e384f8fc9, region_id=RegionOne) {{(pid=155869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:44.218120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:44.219536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802945f-2d5a-42c1-8b3f-05109963b221 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:44.225184 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 646/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 22:49:44 2022] GET /identity/v3/endpoints?service_id=b862d209197e4ad586f23a1e384f8fc9&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:44.230861 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:44.311180 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:44.328600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52835a4-9a55-41fb-afef-86e75e56fec9 None admin] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:44.362928 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:44.363588 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:44.363880 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:44.364165 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:44.364885 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:44.366377 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810e752-4af8-4e0a-97e3-bf58b286f3f7 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:44.373914 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 655/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 22:49:44 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 22:49:46.412073 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ab5d-3421-4974-a379-4a49e612a423 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:46.412656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ab5d-3421-4974-a379-4a49e612a423 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:46.412656 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3ab5d-3421-4974-a379-4a49e612a423 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:46.414065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 647/1302] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:49:46.419255 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:46.421759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:46.421759 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:46.437149 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:49:46.438325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:49:46.504817 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 656/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:49:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 22:49:46.528392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3ab5d-3421-4974-a379-4a49e612a423 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:46.621452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:46.627992 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3ab5d-3421-4974-a379-4a49e612a423 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:46.661664 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:46.662541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:46.662776 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:46.663052 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] PATH_INFO: `/v3/services/placement` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:46.663698 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:46.665085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 22:49:46.678057 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 22:49:46.679262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application with Lock( Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self._enter() Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application return self.creator() Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application created_value = creator( Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: ERROR keystone.server.flask.application Jun 29 22:49:46.680346 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 648/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 22:49:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 22:49:46.685386 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:46.759736 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:46.782141 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80649986-0ece-43d6-b98b-c6f153e65cca None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:46.814308 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:46.814969 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:46.815258 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:46.815539 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] PATH_INFO: `/v3/services` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:46.816238 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] RBAC: Adding query filter params (name=placement) {{(pid=155870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 22:49:46.816577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:46.818461 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915ab2b6-a623-43b5-9247-f44109e1ea17 None admin] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:46.823502 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 657/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 22:49:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 22:49:46.829344 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:49:46.928676 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ceb5-df64-4611-ba08-db5a0582747a None admin] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:49:46.962129 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa71dc5af58e4340b7d041e0647c6ee9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:49:46.962790 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:49:46.963076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:49:46.963354 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:49:46.964095 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:49:46.965562 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfadffb-ab7d-43d0-8eae-7c0d946ae5b5 None admin] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:49:47.023729 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 649/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 22:49:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 22:49:56.829028 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=30 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:49:57.018648 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:31.088835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba828-f90b-4572-8b44-4e2fb63fd72f None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:31.089442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba828-f90b-4572-8b44-4e2fb63fd72f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:31.089442 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ba828-f90b-4572-8b44-4e2fb63fd72f None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:31.090835 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 658/1307] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:31.097084 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26c0f-5ffd-4f4a-a723-c98c16169845 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:31.097554 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26c0f-5ffd-4f4a-a723-c98c16169845 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:31.097642 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd26c0f-5ffd-4f4a-a723-c98c16169845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:31.202568 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-dbd26c0f-5ffd-4f4a-a723-c98c16169845 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:31.204083 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-dbd26c0f-5ffd-4f4a-a723-c98c16169845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:31.341047 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 650/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:31.410054 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:31.410480 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:31.410834 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:31.412930 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 659/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 22:56:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:31.420336 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb6e-9ac7-42ed-aeee-69eb205022a6 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:31.420726 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb6e-9ac7-42ed-aeee-69eb205022a6 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:31.421142 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733edb6e-9ac7-42ed-aeee-69eb205022a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:31.597848 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-733edb6e-9ac7-42ed-aeee-69eb205022a6 None None] MFA Rules not processed for user `f8b1dd859dbb48df97ea0cd5b63d0cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:31.600689 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-733edb6e-9ac7-42ed-aeee-69eb205022a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:31.667027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:31.801803 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 651/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 22:56:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:31.814101 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:31.816128 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:32.050358 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54f1554-7def-4dce-b8bf-8e8193ec81e8 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:32.144300 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:32.145722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:32.146167 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:32.146633 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:32.148766 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:32.212641 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:32.345894 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:32.347416 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd52878-8946-441f-baee-1247c7e478c4 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:32.402816 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 660/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:34.963849 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:34.964964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:34.965255 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:34.966751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 652/1312] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:34.974933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc31c-4fde-4958-8610-f2cec119b9ad None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:34.974933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc31c-4fde-4958-8610-f2cec119b9ad None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:34.974933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc31c-4fde-4958-8610-f2cec119b9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:35.044395 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-f3cdc31c-4fde-4958-8610-f2cec119b9ad None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:35.045533 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-f3cdc31c-4fde-4958-8610-f2cec119b9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:35.142232 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 661/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:35.182068 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:35.183619 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:35.287846 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bb4be7-c0e1-40b2-8e39-2058f8cb5eaa None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:35.359808 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:35.362477 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:35.363137 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:35.363424 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:35.363706 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:35.365428 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:35.477007 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:35.478473 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca51f86-b3f9-41e7-bfc5-68e4ee63a841 service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:35.497588 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 653/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:37.989942 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:37.990387 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:37.990532 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:37.991932 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 662/1315] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:37.997366 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf260-4ad6-4c6b-a0e2-22ad7f44555e None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:37.997756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf260-4ad6-4c6b-a0e2-22ad7f44555e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:37.997933 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf260-4ad6-4c6b-a0e2-22ad7f44555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:38.063076 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e27cf260-4ad6-4c6b-a0e2-22ad7f44555e None None] MFA Rules not processed for user `f31cf071e02b4d11bf022fa40a610218`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:38.064283 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e27cf260-4ad6-4c6b-a0e2-22ad7f44555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:38.117536 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:38.162736 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 654/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:38.202002 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:38.203590 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:38.213367 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:38.308770 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03aac3-aa23-4cb2-b6ef-06fb23d21f8a None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:38.380355 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:38.381042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:38.381331 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:38.381615 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:38.383267 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:38.445912 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:38.492803 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:38.494285 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f901-09f6-454c-84e8-ef0ff6f1f5ff service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:38.513598 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 663/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:41.366738 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:41.367263 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:41.367359 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:41.368764 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 655/1318] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:41.374405 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae145-766a-4b57-909e-96c7bc30ee41 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:41.374831 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae145-766a-4b57-909e-96c7bc30ee41 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:41.374984 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eae145-766a-4b57-909e-96c7bc30ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:41.438944 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-40eae145-766a-4b57-909e-96c7bc30ee41 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:41.440152 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-40eae145-766a-4b57-909e-96c7bc30ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:41.537933 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 664/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:41.578012 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:41.579580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:41.681055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3aed70-881e-44e3-a792-570355a6cf09 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:41.752638 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:41.753281 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:41.753569 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:41.753850 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:41.755463 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:41.763237 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:41.863552 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:41.865047 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e10ddc-332e-47ac-9d17-c8072fbd3fb4 service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:41.883521 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 656/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:44.906595 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:44.907033 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:44.907172 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:44.908625 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 665/1321] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:44.913796 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488566-3bb0-4a8f-9bac-3e9813cc2e16 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:44.914183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488566-3bb0-4a8f-9bac-3e9813cc2e16 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:44.914373 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90488566-3bb0-4a8f-9bac-3e9813cc2e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:44.979396 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-90488566-3bb0-4a8f-9bac-3e9813cc2e16 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:44.980674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-90488566-3bb0-4a8f-9bac-3e9813cc2e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:45.043733 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:45.083667 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 657/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:45.120971 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:45.122572 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:45.144096 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:45.235710 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e67cd-3241-4644-8455-88cbaa7d8213 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:45.313506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:45.314163 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:45.314454 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:45.314738 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:45.316382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:45.387143 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:45.425881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:45.427259 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a570d8-b7dc-42fe-ab91-ee9f3d985db1 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:45.445965 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 666/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:47.550714 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:47.551266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:47.551266 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:47.552725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 658/1324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:47.558481 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b9b3-7907-468f-b11d-e4ebc9a3f3f2 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:47.558909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b9b3-7907-468f-b11d-e4ebc9a3f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:47.559042 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17b9b3-7907-468f-b11d-e4ebc9a3f3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:47.627734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-9a17b9b3-7907-468f-b11d-e4ebc9a3f3f2 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:47.628995 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-9a17b9b3-7907-468f-b11d-e4ebc9a3f3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:47.732673 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 667/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:47.769481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:47.771013 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:47.881778 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30dff6a-a62b-49ad-93dc-ff3ba067e8bc None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:47.958453 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:47.959105 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:47.959391 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:47.959668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:47.961340 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:47.978298 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:48.076893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:48.078418 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2033f-0b34-47f8-ac9d-bcb800bb148a service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:48.097606 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 659/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:50.196954 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:50.197506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:50.197506 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:50.199482 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 668/1327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:50.204902 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87038a49-0a98-465b-a29f-db96ab4f91a8 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:50.205362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87038a49-0a98-465b-a29f-db96ab4f91a8 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:50.205513 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87038a49-0a98-465b-a29f-db96ab4f91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:50.270403 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-87038a49-0a98-465b-a29f-db96ab4f91a8 None None] MFA Rules not processed for user `f31cf071e02b4d11bf022fa40a610218`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:50.271627 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-87038a49-0a98-465b-a29f-db96ab4f91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:50.335582 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:50.366466 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 660/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:50.405193 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:50.406714 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:50.437444 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:50.510685 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e23d9c-10cf-4bfc-8d94-1f66d573a946 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:50.582655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:50.583307 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:50.583600 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:50.583884 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:50.585577 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:50.662437 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:50.694824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:50.696280 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811813-9f7c-4a7e-b773-aa9b734fba72 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:50.713858 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 669/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:53.183134 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09bcc3-d4af-4304-9808-504dab720522 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:53.183653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09bcc3-d4af-4304-9808-504dab720522 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:53.183653 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09bcc3-d4af-4304-9808-504dab720522 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:53.185099 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 661/1330] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:53.190317 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873cd9b-ce9d-4cd2-9401-24b59f13854a None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:53.190725 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873cd9b-ce9d-4cd2-9401-24b59f13854a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:53.190886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873cd9b-ce9d-4cd2-9401-24b59f13854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:53.254863 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-a873cd9b-ce9d-4cd2-9401-24b59f13854a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:53.256059 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a873cd9b-ce9d-4cd2-9401-24b59f13854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:53.350813 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 670/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:53.402446 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:53.402736 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:53.403017 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:53.404580 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 662/1332] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 22:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:53.410371 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c12cb-9c1b-4057-9824-2f3dc5f85d17 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:53.410676 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c12cb-9c1b-4057-9824-2f3dc5f85d17 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:53.410959 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c12cb-9c1b-4057-9824-2f3dc5f85d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:53.455818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:53.486666 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-d89c12cb-9c1b-4057-9824-2f3dc5f85d17 None None] MFA Rules not processed for user `f8b1dd859dbb48df97ea0cd5b63d0cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:53.488507 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-d89c12cb-9c1b-4057-9824-2f3dc5f85d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:53.563212 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 671/1333] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 22:56:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:56:53.572739 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:53.574288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:53.678423 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0506ba-90cb-4825-9ec0-c6d2892e208c None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:53.751592 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:53.752165 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:53.752478 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:53.752762 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:53.754380 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:53.780712 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:53.860629 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:53.862071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d9f01-9854-4426-a476-b406745b1985 service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:53.880979 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 663/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:56.190229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:56.190761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:56.190761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:56.192095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 672/1335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 22:56:56.197962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f8f1-b783-4602-9350-6ca83c4a492a None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:56.198399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f8f1-b783-4602-9350-6ca83c4a492a None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:56.198533 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096f8f1-b783-4602-9350-6ca83c4a492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:56.261840 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-d096f8f1-b783-4602-9350-6ca83c4a492a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:56.263027 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-d096f8f1-b783-4602-9350-6ca83c4a492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:56.335387 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:56.357256 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 664/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:56.398340 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:56.399871 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:56.503260 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3567754-c896-4179-ad76-a42185a4ca5d None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:56:56.530869 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:56.575794 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:56:56.576478 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:56.576774 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:56.577061 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:56.578732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:56.684903 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:56:56.686334 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53310b-2389-43b0-9909-4c5f5546a547 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:56:56.704080 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 673/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:56:59.651410 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:59.651973 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:59.652077 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:59.653427 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 665/1338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:56:59.658756 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177192ff-a3fe-470d-81f4-1ea9f185e461 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:56:59.659187 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177192ff-a3fe-470d-81f4-1ea9f185e461 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:56:59.659325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177192ff-a3fe-470d-81f4-1ea9f185e461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:56:59.722495 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-177192ff-a3fe-470d-81f4-1ea9f185e461 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:56:59.723658 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-177192ff-a3fe-470d-81f4-1ea9f185e461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:59.732321 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:56:59.820810 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 674/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:56:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:56:59.857071 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:56:59.858605 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:56:59.960719 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d91f71-07c1-4d82-9926-5454682086a7 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:00.034668 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:00.035341 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:00.035663 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:00.035943 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:00.037600 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:00.074055 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:00.146314 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:00.147751 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343ff6c-1bc8-41ed-ac63-16d2ba56e5b0 service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:00.166811 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 666/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:56:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:04.401129 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:04.401621 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:04.401874 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:04.403220 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 675/1341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:04.409460 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e38e5-f9ba-4ff1-861e-0d00b3c8749c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:04.409948 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e38e5-f9ba-4ff1-861e-0d00b3c8749c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:04.410036 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e38e5-f9ba-4ff1-861e-0d00b3c8749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:04.484288 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-836e38e5-f9ba-4ff1-861e-0d00b3c8749c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:04.485601 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-836e38e5-f9ba-4ff1-861e-0d00b3c8749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:04.590116 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=100 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:04.603583 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 667/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:04.643553 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:04.645860 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:04.745823 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd64c0-f14d-460f-9deb-27b44451991e None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:04.749466 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:04.750126 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:04.750422 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:04.750713 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:04.760755 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:04.762208 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce95d9f-d556-42df-8697-e279a0c271c1 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:04.771675 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 676/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:07.780284 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1c77-9f4f-4d3c-a749-56d1b154622d None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:07.780854 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1c77-9f4f-4d3c-a749-56d1b154622d None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:07.780944 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1c77-9f4f-4d3c-a749-56d1b154622d None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:07.782292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 668/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:07.788112 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e4f0-a215-4316-b55c-62469460d94f None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:07.788617 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e4f0-a215-4316-b55c-62469460d94f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:07.788734 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e4f0-a215-4316-b55c-62469460d94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:07.818301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-3f92e4f0-a215-4316-b55c-62469460d94f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:07.819514 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-3f92e4f0-a215-4316-b55c-62469460d94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:07.850093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:07.901155 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 677/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:07.937853 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1c77-9f4f-4d3c-a749-56d1b154622d None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:07.949111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1c77-9f4f-4d3c-a749-56d1b154622d None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:07.952675 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:07.953390 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:07.953749 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:07.954103 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:07.963661 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:07.967779 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7660f9-a55b-4972-9b4b-4c7a96657c3d service neutron] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:07.974952 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 669/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:12.319083 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792d9a6-b4a6-4e77-9a0c-e8946f566ced None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:12.319562 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792d9a6-b4a6-4e77-9a0c-e8946f566ced None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:12.319681 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792d9a6-b4a6-4e77-9a0c-e8946f566ced None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:12.321148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 678/1347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:12.326970 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118593-186f-4141-ba5a-301a86416864 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:12.327411 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118593-186f-4141-ba5a-301a86416864 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:12.327523 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9118593-186f-4141-ba5a-301a86416864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:12.347044 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-a9118593-186f-4141-ba5a-301a86416864 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:12.348382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-a9118593-186f-4141-ba5a-301a86416864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:12.356352 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 670/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:57:12.395743 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792d9a6-b4a6-4e77-9a0c-e8946f566ced None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:12.412886 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792d9a6-b4a6-4e77-9a0c-e8946f566ced None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:12.416425 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8b1dd859dbb48df97ea0cd5b63d0cd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:12.417095 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:12.417382 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:12.417664 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:12.426671 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:12.428093 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76547f23-62a7-4b0c-a2f6-fa87b2951bb4 service neutron] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:12.441829 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 679/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:17.391699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697ecf-1529-48db-bf26-294fdd2025f8 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:17.391699 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697ecf-1529-48db-bf26-294fdd2025f8 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:17.392159 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16697ecf-1529-48db-bf26-294fdd2025f8 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:17.394254 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 671/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:17.399013 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a294-09f7-423c-821b-91485e7dad4d None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:17.399448 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a294-09f7-423c-821b-91485e7dad4d None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:17.399646 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a294-09f7-423c-821b-91485e7dad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:17.493567 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-37c6a294-09f7-423c-821b-91485e7dad4d None None] MFA Rules not processed for user `35c4f702a9324765b923d4d4bf04aa17`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:17.495605 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-37c6a294-09f7-423c-821b-91485e7dad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:17.597048 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 680/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:57:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:21.834836 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6e09e-c970-4693-8cf1-35e2dffcf8b3 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:21.835893 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6e09e-c970-4693-8cf1-35e2dffcf8b3 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:21.836302 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6e09e-c970-4693-8cf1-35e2dffcf8b3 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:21.837961 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 672/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:21.843032 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e49e-b62d-49da-a13e-16d12cd59b7c None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:21.843474 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e49e-b62d-49da-a13e-16d12cd59b7c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:21.843606 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517e49e-b62d-49da-a13e-16d12cd59b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:21.862291 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-c517e49e-b62d-49da-a13e-16d12cd59b7c None None] MFA Rules not processed for user `35c4f702a9324765b923d4d4bf04aa17`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:21.863473 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-c517e49e-b62d-49da-a13e-16d12cd59b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:21.873091 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 681/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:22.341412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=13 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:23.418140 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384cd6-c5e8-49d4-a8f0-76b37e7bfed9 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:23.418740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384cd6-c5e8-49d4-a8f0-76b37e7bfed9 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:23.418740 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85384cd6-c5e8-49d4-a8f0-76b37e7bfed9 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:23.419987 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 673/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 22:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:23.425106 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc645-6c43-4efb-b52d-8a4ac931f2d7 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:23.425522 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc645-6c43-4efb-b52d-8a4ac931f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:23.425820 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cc645-6c43-4efb-b52d-8a4ac931f2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:23.443722 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-205cc645-6c43-4efb-b52d-8a4ac931f2d7 None None] MFA Rules not processed for user `35c4f702a9324765b923d4d4bf04aa17`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:23.445046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-205cc645-6c43-4efb-b52d-8a4ac931f2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:23.453732 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 682/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:27.150551 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4818e-0858-4662-907c-837199fa48cf None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:27.151090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4818e-0858-4662-907c-837199fa48cf None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:27.151090 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4818e-0858-4662-907c-837199fa48cf None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:27.152937 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 674/1356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:27.158624 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7258b-c9d5-4389-a029-473d9062f803 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:27.165041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7258b-c9d5-4389-a029-473d9062f803 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:27.165041 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7258b-c9d5-4389-a029-473d9062f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:27.181199 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-65a7258b-c9d5-4389-a029-473d9062f803 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:27.182398 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-65a7258b-c9d5-4389-a029-473d9062f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:27.194619 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 683/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 22:57:27.252765 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39046-4ae7-4fac-b0a2-45882805ec37 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:27.253300 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39046-4ae7-4fac-b0a2-45882805ec37 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:27.253750 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39046-4ae7-4fac-b0a2-45882805ec37 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:27.255548 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 675/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 22:57:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:27.268691 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf81ea-1ba8-4369-a47e-e29e1c6a0809 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:27.276493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf81ea-1ba8-4369-a47e-e29e1c6a0809 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:27.276493 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf81ea-1ba8-4369-a47e-e29e1c6a0809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:27.318906 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:27.327645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-cccf81ea-1ba8-4369-a47e-e29e1c6a0809 None None] MFA Rules not processed for user `8282dd1579c749378efdccf403a539c4`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:27.328990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-cccf81ea-1ba8-4369-a47e-e29e1c6a0809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:27.421921 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 684/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:27.429949 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d39046-4ae7-4fac-b0a2-45882805ec37 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:27.447183 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d39046-4ae7-4fac-b0a2-45882805ec37 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:27.453928 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:27.454735 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:27.455065 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:27.455353 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:27.465114 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:27.466707 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a16c6-2790-4189-8694-bb28d6e564d0 service nova] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:27.476899 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 676/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 22:57:29.741747 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5b-f89c-44b8-9b8c-9fcd0c68434c None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:29.742219 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5b-f89c-44b8-9b8c-9fcd0c68434c None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:29.742325 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a74c5b-f89c-44b8-9b8c-9fcd0c68434c None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:29.743889 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 685/1361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:29.748960 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e16b1-9bd0-4ad5-b84f-aa5294550d2f None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:29.749370 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e16b1-9bd0-4ad5-b84f-aa5294550d2f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:29.749527 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e16b1-9bd0-4ad5-b84f-aa5294550d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:29.768292 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e56e16b1-9bd0-4ad5-b84f-aa5294550d2f None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:29.769612 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e56e16b1-9bd0-4ad5-b84f-aa5294550d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:29.778247 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 677/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:29.823233 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74c5b-f89c-44b8-9b8c-9fcd0c68434c None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:29.838508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a74c5b-f89c-44b8-9b8c-9fcd0c68434c None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:29.844014 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:29.844779 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:29.845144 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:29.845503 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:29.854898 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:29.856678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75087f6-fd43-4a7c-8dc9-f0d840ea0d41 service nova] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:29.868881 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 686/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:32.407962 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebfff-628e-47ac-85d2-c3d5adfd5557 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:32.408500 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebfff-628e-47ac-85d2-c3d5adfd5557 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:32.408621 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ebfff-628e-47ac-85d2-c3d5adfd5557 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:32.409986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 678/1364] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:32.415301 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f7c40-d27f-4316-9e9b-a9ff3feb869e None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:32.415693 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f7c40-d27f-4316-9e9b-a9ff3feb869e None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:32.415875 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f7c40-d27f-4316-9e9b-a9ff3feb869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:32.434431 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-d62f7c40-d27f-4316-9e9b-a9ff3feb869e None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:32.435579 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-d62f7c40-d27f-4316-9e9b-a9ff3feb869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:32.443467 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 687/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:32.489841 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8568cc-a45f-44cb-8e75-91e0650ddf2f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:32.490131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8568cc-a45f-44cb-8e75-91e0650ddf2f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:32.490412 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8568cc-a45f-44cb-8e75-91e0650ddf2f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:32.491795 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 679/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 22:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:32.497655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f0e5e-a404-423b-ba42-bed80417cd3f None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:32.502644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f0e5e-a404-423b-ba42-bed80417cd3f None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:32.502644 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f0e5e-a404-423b-ba42-bed80417cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:32.517694 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-fd7f0e5e-a404-423b-ba42-bed80417cd3f None None] MFA Rules not processed for user `8282dd1579c749378efdccf403a539c4`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:32.518891 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-fd7f0e5e-a404-423b-ba42-bed80417cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:32.534328 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 688/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:32.542632 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8568cc-a45f-44cb-8e75-91e0650ddf2f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:32.557814 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8568cc-a45f-44cb-8e75-91e0650ddf2f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:32.563181 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:32.563828 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:32.564120 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:32.564436 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:32.572631 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:32.574226 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0919cf-54bc-4308-bc12-098a700d62ff service nova] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:32.583708 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 680/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:34.834761 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccbc-8872-4a10-9d29-154957ae8a26 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:34.835637 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccbc-8872-4a10-9d29-154957ae8a26 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:34.835921 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eccbc-8872-4a10-9d29-154957ae8a26 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:34.837376 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 689/1369] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:34.842804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfc7-49e6-4430-bd19-9f2fb7598c2c None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:34.843274 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfc7-49e6-4430-bd19-9f2fb7598c2c None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:34.843360 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eadfc7-49e6-4430-bd19-9f2fb7598c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:34.862936 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-b8eadfc7-49e6-4430-bd19-9f2fb7598c2c None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:34.864179 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-b8eadfc7-49e6-4430-bd19-9f2fb7598c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:34.879400 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 681/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:34.926108 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eccbc-8872-4a10-9d29-154957ae8a26 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:34.954986 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eccbc-8872-4a10-9d29-154957ae8a26 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:34.961413 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:34.962198 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:34.962559 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:34.962920 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:34.975445 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:34.979030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba014bd7-32f8-4a4f-883c-0afca498e231 service nova] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:34.998383 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 690/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:35.391328 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a165-1ef7-4ba6-aa11-0aa110a9d0ac None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:35.391516 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a165-1ef7-4ba6-aa11-0aa110a9d0ac None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:35.391827 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a165-1ef7-4ba6-aa11-0aa110a9d0ac None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:35.393541 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 682/1372] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:35.399243 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a94ad-47c4-47ae-9a23-66599c075b0a None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:35.399536 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a94ad-47c4-47ae-9a23-66599c075b0a None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:35.399818 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a94ad-47c4-47ae-9a23-66599c075b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:35.418320 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-5f7a94ad-47c4-47ae-9a23-66599c075b0a None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:35.419547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-5f7a94ad-47c4-47ae-9a23-66599c075b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:35.427907 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 691/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:35.781887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2a5-0e28-4aba-896d-fe8d6c72c32f None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:35.781887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2a5-0e28-4aba-896d-fe8d6c72c32f None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:35.781887 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea2a5-0e28-4aba-896d-fe8d6c72c32f None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:35.784862 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 683/1374] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jun 29 22:57:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:35.790508 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433393-1e16-4def-bf1f-c1fc75d4c378 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:35.790909 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433393-1e16-4def-bf1f-c1fc75d4c378 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:35.791282 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433393-1e16-4def-bf1f-c1fc75d4c378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:35.842581 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-36433393-1e16-4def-bf1f-c1fc75d4c378 None None] MFA Rules not processed for user `65916dc35ed54d6098bfb47ee20c6595`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:35.843990 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-36433393-1e16-4def-bf1f-c1fc75d4c378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:35.918768 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 692/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jun 29 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:35.926613 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea2a5-0e28-4aba-896d-fe8d6c72c32f None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:35.939271 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea2a5-0e28-4aba-896d-fe8d6c72c32f None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:35.942804 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65916dc35ed54d6098bfb47ee20c6595', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:35.943458 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:35.943747 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:35.944029 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:35.954085 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:35.955549 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e807cb-6ad0-4ead-8d05-b139fee24769 service cinder] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:35.972243 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 684/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:37.262335 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c25-f391-43a1-9d93-903deb0d8ed1 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:37.262925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c25-f391-43a1-9d93-903deb0d8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:37.262925 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c25-f391-43a1-9d93-903deb0d8ed1 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:37.264272 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 693/1377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:37.269674 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64dc7-5d8e-421b-b8ef-ef09d822e5ce None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:37.270107 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64dc7-5d8e-421b-b8ef-ef09d822e5ce None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:37.270399 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64dc7-5d8e-421b-b8ef-ef09d822e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:37.289244 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-f7d64dc7-5d8e-421b-b8ef-ef09d822e5ce None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:37.290986 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-f7d64dc7-5d8e-421b-b8ef-ef09d822e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:37.299341 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 685/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:37.343540 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450c25-f391-43a1-9d93-903deb0d8ed1 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:37.358412 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450c25-f391-43a1-9d93-903deb0d8ed1 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:37.364030 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:37.364718 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:37.365008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:37.365289 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:37.374237 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:37.375819 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937e84-99aa-4ad3-9bc0-04c0867d27a7 service nova] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:37.379686 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=100 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:37.386004 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 694/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:39.705308 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5fcef-68ca-4aa1-9c0a-f5b8462c483e None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:39.705818 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5fcef-68ca-4aa1-9c0a-f5b8462c483e None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:39.705939 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5fcef-68ca-4aa1-9c0a-f5b8462c483e None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:39.707262 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 686/1380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:39.715552 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a79fd2-e23c-4f03-911d-620ae7b0fd09 None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:39.716086 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a79fd2-e23c-4f03-911d-620ae7b0fd09 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:39.716366 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a79fd2-e23c-4f03-911d-620ae7b0fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:39.745626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-e9a79fd2-e23c-4f03-911d-620ae7b0fd09 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:39.748087 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-e9a79fd2-e23c-4f03-911d-620ae7b0fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:39.768688 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 695/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:39.808131 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5fcef-68ca-4aa1-9c0a-f5b8462c483e None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:39.831187 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5fcef-68ca-4aa1-9c0a-f5b8462c483e None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:39.839964 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:39.840845 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:39.841301 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:39.841725 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:39.853043 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:39.853984 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60803c12-2463-4cbb-a607-863b4266625a service nova] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:39.865111 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 687/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:42.105563 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e9fa-49f8-4d41-8a88-4af181cd6585 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:42.106055 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e9fa-49f8-4d41-8a88-4af181cd6585 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:42.106148 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427e9fa-49f8-4d41-8a88-4af181cd6585 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:42.107509 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 696/1383] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:42.112738 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5aca3-d29f-4e82-9703-2f3cd9849cf5 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:42.113146 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5aca3-d29f-4e82-9703-2f3cd9849cf5 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:42.113305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5aca3-d29f-4e82-9703-2f3cd9849cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:42.132088 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-e1b5aca3-d29f-4e82-9703-2f3cd9849cf5 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:42.133969 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-e1b5aca3-d29f-4e82-9703-2f3cd9849cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:42.153581 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 688/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:42.185547 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e9fa-49f8-4d41-8a88-4af181cd6585 None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:42.201008 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427e9fa-49f8-4d41-8a88-4af181cd6585 None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:42.206678 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:42.207333 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:42.207626 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:42.207917 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:42.216627 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:42.218229 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094a5b-ba4f-4e63-8741-6eb38e51cdbf service nova] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:42.228727 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 697/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:44.282866 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3699-6431-4265-b192-bcb0eed35651 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:44.283382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3699-6431-4265-b192-bcb0eed35651 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:44.283382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3699-6431-4265-b192-bcb0eed35651 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:44.284761 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 689/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:44.290735 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a0b39-fdbf-46d2-801f-eeb95d6205ab None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:44.291171 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a0b39-fdbf-46d2-801f-eeb95d6205ab None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:44.291434 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a0b39-fdbf-46d2-801f-eeb95d6205ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:44.309333 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-a99a0b39-fdbf-46d2-801f-eeb95d6205ab None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:44.310549 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-a99a0b39-fdbf-46d2-801f-eeb95d6205ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:44.318787 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 698/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:44.364834 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3699-6431-4265-b192-bcb0eed35651 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:44.379135 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3699-6431-4265-b192-bcb0eed35651 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:44.384873 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:44.385519 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:44.385807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:44.386087 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:44.394362 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:44.395956 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319596d4-5739-4ea4-ab53-8291585f4e6f service nova] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:44.405905 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 690/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:45.893362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d92-0ac3-4278-86f2-a926a6049148 None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:45.893362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d92-0ac3-4278-86f2-a926a6049148 None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:45.893362 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd15d92-0ac3-4278-86f2-a926a6049148 None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:45.894717 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 699/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:45.900481 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc2d-5318-4275-90c9-1da1a1efa7b1 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:45.900892 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc2d-5318-4275-90c9-1da1a1efa7b1 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:45.901056 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fcc2d-5318-4275-90c9-1da1a1efa7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:45.918975 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-707fcc2d-5318-4275-90c9-1da1a1efa7b1 None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:45.920171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-707fcc2d-5318-4275-90c9-1da1a1efa7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:45.928171 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 691/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:45.983824 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f4de-643f-4db6-a429-8843f76f01ac None None] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:45.989348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f4de-643f-4db6-a429-8843f76f01ac None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:45.989348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f4de-643f-4db6-a429-8843f76f01ac None None] PATH_INFO: `/` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:45.989348 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 700/1391] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jun 29 22:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:45.990728 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936e40-df43-4b19-8e45-69e0989d0770 None None] REQUEST_METHOD: `POST` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:45.991022 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936e40-df43-4b19-8e45-69e0989d0770 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:45.991305 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2936e40-df43-4b19-8e45-69e0989d0770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:46.042267 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.auth.core [None req-d2936e40-df43-4b19-8e45-69e0989d0770 None None] MFA Rules not processed for user `1d09e711c04142f18a4e260c1cc44953`. Rule list: `[]` (Enabled: `True`). {{(pid=155869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:46.043487 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.fernet_utils [None req-d2936e40-df43-4b19-8e45-69e0989d0770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:46.105602 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 692/1392] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jun 29 22:57:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:46.112994 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f4de-643f-4db6-a429-8843f76f01ac None None] Authenticating user token {{(pid=155870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:46.123518 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f4de-643f-4db6-a429-8843f76f01ac None None] Validating token access rules against request {{(pid=155870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:46.127007 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d09e711c04142f18a4e260c1cc44953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:46.127655 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] REQUEST_METHOD: `GET` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:46.127945 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:46.128226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:46.138226 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:46.139689 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d9371-69d5-4fba-b43f-77d47134e9f1 service glance] RBAC: Authorization granted {{(pid=155870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:46.150146 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 701/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:46.543032 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde1ab-abdb-4c84-b8ed-eb5282402761 None None] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:46.543249 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde1ab-abdb-4c84-b8ed-eb5282402761 None None] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:46.543540 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bde1ab-abdb-4c84-b8ed-eb5282402761 None None] PATH_INFO: `/` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:46.545014 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 693/1394] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 22:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 22:57:46.550234 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745dd4-da0f-43f1-8fdd-0305b82744ed None None] REQUEST_METHOD: `POST` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:46.550565 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745dd4-da0f-43f1-8fdd-0305b82744ed None None] SCRIPT_NAME: `/identity` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:46.550853 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745dd4-da0f-43f1-8fdd-0305b82744ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=155870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:46.569052 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.auth.core [None req-79745dd4-da0f-43f1-8fdd-0305b82744ed None None] MFA Rules not processed for user `aa71dc5af58e4340b7d041e0647c6ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=155870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 22:57:46.570264 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG keystone.common.fernet_utils [None req-79745dd4-da0f-43f1-8fdd-0305b82744ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=155870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 22:57:46.578822 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: [pid: 155870|app: 0|req: 702/1395] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 22:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 22:57:46.623448 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bde1ab-abdb-4c84-b8ed-eb5282402761 None None] Authenticating user token {{(pid=155869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 22:57:46.638756 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bde1ab-abdb-4c84-b8ed-eb5282402761 None None] Validating token access rules against request {{(pid=155869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 22:57:46.644382 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8282dd1579c749378efdccf403a539c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5a745493cb642b28a3220e7c7634b76', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=155869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 22:57:46.645097 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] REQUEST_METHOD: `GET` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 22:57:46.645392 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] SCRIPT_NAME: `/identity` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 22:57:46.645680 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=155869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 22:57:46.654166 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 22:57:46.655807 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37935a7-43d3-4951-9907-7ed9ac0b36c8 service nova] RBAC: Authorization granted {{(pid=155869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 22:57:46.665452 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: [pid: 155869|app: 0|req: 694/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 22:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 22:57:56.564046 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: DEBUG dbcounter [-] [155870] Writing DB stats keystone:SELECT=22 {{(pid=155870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:57:56.661144 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: DEBUG dbcounter [-] [155869] Writing DB stats keystone:SELECT=89 {{(pid=155869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 22:58:07.997504 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: Wed Jun 29 22:58:07 2022 - graceful shutdown triggered... Jun 29 22:58:07.997805 dv-cinder-812685-13-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jun 29 22:58:07.998242 dv-cinder-812685-13-iscsi devstack@keystone.service[155869]: Gracefully killing worker 1 (pid: 155869)... Jun 29 22:58:07.998645 dv-cinder-812685-13-iscsi devstack@keystone.service[155870]: Gracefully killing worker 2 (pid: 155870)... Jun 29 22:58:08.998798 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: worker 1 buried after 1 seconds Jun 29 22:58:08.999254 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: worker 2 buried after 1 seconds Jun 29 22:58:08.999254 dv-cinder-812685-13-iscsi devstack@keystone.service[155855]: goodbye to uWSGI. Jun 29 22:58:09.000288 dv-cinder-812685-13-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jun 29 22:58:09.000869 dv-cinder-812685-13-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. Jun 29 23:03:30.277168 dv-cinder-812685-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 23:03:30.285517 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 23:03:30 2022] *** Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: nodename: dv-cinder-812685-13-iscsi Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: machine: x86_64 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: clock source: unix Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: pcre jit disabled Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: detected number of CPU cores: 4 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: current working directory: / Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: detected binary path: /usr/bin/uwsgi-core Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: your processes number limit is 47680 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: your memory page size is 4096 bytes Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: detected max file descriptor number: 2048 Jun 29 23:03:30.287557 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: lock engine: pthread robust mutexes Jun 29 23:03:30.288775 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: thunder lock: enabled Jun 29 23:03:30.288775 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 23:03:30.288775 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 23:03:30.332162 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: Python main interpreter initialized at 0x55771e4549c0 Jun 29 23:03:30.332162 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: python threads support enabled Jun 29 23:03:30.332162 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: your server socket listen backlog is limited to 100 connections Jun 29 23:03:30.332162 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: your mercy for graceful operations on workers is 90 seconds Jun 29 23:03:30.332639 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 23:03:30.332639 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: *** Operational MODE: preforking *** Jun 29 23:03:30.332861 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: *** uWSGI is running in multiple interpreter mode *** Jun 29 23:03:30.332861 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: spawned uWSGI master process (pid: 221113) Jun 29 23:03:30.333062 dv-cinder-812685-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 23:03:30.333982 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: spawned uWSGI worker 1 (pid: 221125, cores: 1) Jun 29 23:03:30.334089 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: spawned uWSGI worker 2 (pid: 221126, cores: 1) Jun 29 23:03:30.334166 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 23:03:35.790777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:03:35.790777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: from cryptography.utils import int_from_bytes Jun 29 23:03:35.791600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:03:35.791600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: from cryptography.utils import int_from_bytes Jun 29 23:03:35.792111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:03:35.792111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: from cryptography.utils import int_from_bytes Jun 29 23:03:35.792275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:03:35.792275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: from cryptography.utils import int_from_bytes Jun 29 23:03:35.840340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 23:03:35.840525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 23:03:35.840620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 23:03:35.840721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 23:03:35.840817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] command line args: [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 23:03:35.840906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] command line args: [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 23:03:35.842153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 23:03:35.842250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 23:03:35.842344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ================================================================================ {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 23:03:35.842438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ================================================================================ {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 23:03:35.842598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] admin_token = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.842697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] admin_token = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.842858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] config_dir = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.842955 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] config_dir = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843148 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] config_source = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] config_source = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] debug = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] debug = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.843898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] insecure_debug = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] insecure_debug = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844636 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.844985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_config_append = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_config_append = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845810 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_dir = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.845970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_dir = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_file = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_file = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.846885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847561 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847832 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.847919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848210 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848505 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] notification_format = cadf {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.848838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] notification_format = cadf {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849630 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849727 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] publish_errors = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] publish_errors = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849905 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.849998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.850888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] standard_threads = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] standard_threads = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] strict_password_check = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] strict_password_check = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851604 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] use_eventlog = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] use_eventlog = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] use_journal = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.851958 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] use_journal = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] use_json = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] use_json = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] use_stderr = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] use_stderr = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] use_syslog = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] use_syslog = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] watch_log_file = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] watch_log_file = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:03:35.852845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.852933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.853920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854406 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854552 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.854892 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.855890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.856887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857053 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857401 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.857886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858417 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858827 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.858922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859386 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.859857 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860523 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.860854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861105 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.861986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862791 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.862930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863163 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863265 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863397 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863664 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.863918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864731 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.864966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865109 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865713 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.865927 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866549 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.866890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867844 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.867990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868609 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.868993 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.869996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870334 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870725 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.870964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.enabled = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871310 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.enabled = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.871940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872434 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.872916 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873417 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.873997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.874968 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875109 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.875907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876389 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876551 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.876884 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877145 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877629 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877798 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.877896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.external = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.external = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.mapped = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.mapped = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.878911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.879047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.879625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.879802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.password = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.879898 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.password = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] auth.token = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] auth.token = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880530 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] catalog.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] catalog.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.880879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881019 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881846 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.881990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882745 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.882988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.883743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884351 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884635 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.884884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.885936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886664 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.886996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.887881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888042 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888145 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888561 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.888893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889053 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889541 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889636 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889791 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.889893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890117 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890267 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.890990 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891078 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.891968 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.892972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893069 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893849 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.893997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894246 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.894748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.895366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.895519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.895632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.895762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.895862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.896867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897121 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897275 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.897859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898341 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.password = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.password = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.898964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899054 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899308 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899537 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.899930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.900925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901177 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901517 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901770 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.901998 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902233 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.902965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903457 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903607 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903857 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.903952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904807 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.904907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905773 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.905869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906019 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.906991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907470 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907709 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907809 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.907947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908036 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.908961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] policy.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] policy.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909774 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.909917 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] receipt.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] receipt.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910247 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.910938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911019 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.911991 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] revoke.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.912993 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] revoke.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] role.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] role.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913860 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] role.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.913950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] role.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] role.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914202 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] role.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] role.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] role.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.914932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915183 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.915946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916582 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.916923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917335 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.917996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918151 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918834 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.918993 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919739 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.919995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.920971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921314 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.921971 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922300 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.922921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.provider = fernet {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923270 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.provider = fernet {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.923919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924253 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.924914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] trust.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] trust.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925880 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.925976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926395 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.926933 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927031 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.connection = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.connection = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.927933 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928271 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928677 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.928917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929155 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929249 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929884 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.929989 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930856 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.930947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931574 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:03:35.931767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=221126) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 23:03:35.931849 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=221125) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 23:03:35.961961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.962169 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.962439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.962806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.963075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.963337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.971225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:35.972046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.000006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.000233 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.006227 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.006462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.143323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.143696 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.192488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.192721 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.193136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.193375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.259348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.259507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.259725 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.259831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.259939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260037 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260216 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260349 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260465 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.260815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.283775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284007 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284228 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.284971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.285123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.285284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.285428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.285591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.285591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.296009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.296325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.309942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310249 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310549 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=221126) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.310987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=221125) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:03:36.339195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.339404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:03:36.339659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.339816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.339958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:03:36.340107 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:03:36.340271 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.340449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:03:36.340600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.340748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.340943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.341098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.341242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.341390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.341534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.341785 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.352556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.352835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353107 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.353974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.361497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.362075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.365571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.365855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.366140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.366877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367475 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367629 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.367911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368517 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.368684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.394828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.395056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.396462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.396692 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.396843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.396994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.401979 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.402180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.402321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.402476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.402620 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.402776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.409942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.410100 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.410253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.410881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.415228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.415375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.415529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.415680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.415841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416790 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.416961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.417095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.417198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.436338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.436569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.436672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.436845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.441224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.441408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.444949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.445246 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.446081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.450396 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.451508 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.454093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.455232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.457797 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.458100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.458391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.458684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.458945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.459056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.459237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.459335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.459527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.459817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.460107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.460385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.478767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.479069 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.479336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.479598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.479869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.480154 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.480442 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.480701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.487499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.489108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.489799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.490079 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.490837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.491114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.493174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.493456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.494196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.494475 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.495125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.495418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.495721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.496144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.496450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.496751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.510736 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.510954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.511230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.511515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.511794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.512064 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.512257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.512364 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.512568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.512858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.513151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.513434 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.513708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.513983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.530319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.531911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.533604 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.535237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.537436 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.539042 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.539135 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.540693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.540839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.541118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.541402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.542467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.542749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.543046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.548989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.550368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.550595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.552643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.554516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.554810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.555095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.555368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.555876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.556177 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.556482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.556761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.564535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.564822 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.565108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.565975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.566265 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.566576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.572986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=221126) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.573265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.573545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.573821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.574099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.574377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.574475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=221125) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:03:36.574657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.574749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.574932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575035 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.575910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576082 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=221126) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.576742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.577006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.577297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.577567 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.577836 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.578108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=221125) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:03:36.615125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55771e4549c0 pid: 221126 (default app) Jun 29 23:03:36.616769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55771e4549c0 pid: 221125 (default app) Jun 29 23:03:36.618525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bf56-4eb0-44a2-9c9a-db4f4295cce5 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:36.618829 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bf56-4eb0-44a2-9c9a-db4f4295cce5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:36.619109 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729bf56-4eb0-44a2-9c9a-db4f4295cce5 None None] PATH_INFO: `/v3` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:36.623312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jun 29 23:03:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:45.274990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:45.275600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:45.275600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:45.279922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:03:45.286095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:45.286536 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:45.286803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:45.359079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: INFO dbcounter [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] Registered counter for database keystone Jun 29 23:03:45.380504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG oslo_db.sqlalchemy.engines [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=221126) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 23:03:45.387154 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writer thread running {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 23:03:45.565912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG passlib.handlers.bcrypt [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=221126) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 23:03:45.566819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG passlib.handlers.bcrypt [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=221126) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 23:03:45.621177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:45.622776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:45.744356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 29 23:03:45.768188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:45.840060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: INFO dbcounter [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] Registered counter for database keystone Jun 29 23:03:45.859889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG oslo_db.sqlalchemy.engines [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=221125) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 23:03:45.866708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writer thread running {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 23:03:45.986925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8264b05-d345-4f4e-b8c6-1fe62c71e577 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:45.991859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a5902da22b4735a197547a87e04a33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:45.992578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:45.992863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:45.993144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:46.001576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:46.053591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 23:03:46.053942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0211ea-c6b3-4cea-9cde-c4b93f761a7b admin admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:46.063585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 23:03:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 23:03:46.069593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:46.087114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e966e1-85d7-43b2-850e-2b7fce02315a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:46.091668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a5902da22b4735a197547a87e04a33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:46.092781 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:46.093073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:46.093353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] PATH_INFO: `/v3/projects/44a5902da22b4735a197547a87e04a33` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:46.094880 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=44a5902da22b4735a197547a87e04a33)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:46.145979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 23:03:46.146330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08470c0-b0b7-4c89-a9fe-29a707903fe3 admin admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:46.150991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jun 29 23:03:46 2022] GET /identity/v3/projects/44a5902da22b4735a197547a87e04a33 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:48.164352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f963-32fb-49f9-8981-4ac9ff1653e7 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:48.164924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f963-32fb-49f9-8981-4ac9ff1653e7 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:48.165040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950f963-32fb-49f9-8981-4ac9ff1653e7 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:48.169116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:48.174433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:48.174870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:48.174973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:48.194437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:48.195944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:48.204025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 23:03:48.226158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950f963-32fb-49f9-8981-4ac9ff1653e7 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:48.238612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950f963-32fb-49f9-8981-4ac9ff1653e7 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:48.242878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a5902da22b4735a197547a87e04a33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:48.243503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:48.243787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:48.244065 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:48.251684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:48.254105 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6482952-50fc-4f68-9444-fd62365b3cfb admin admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:48.263093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 23:03:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 23:03:48.268324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:48.277398 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411f0fb-c6ca-437f-a2c4-116820214c85 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:48.281812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '44a5902da22b4735a197547a87e04a33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:48.282676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:48.282967 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:48.283248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:48.284702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:48.286526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de44d0f-15ad-4891-9495-6ada82a50dbf admin admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:48.288103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jun 29 23:03:48 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:50.385674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c794-7631-4ad4-b327-e321ec8a12fd None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.386240 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c794-7631-4ad4-b327-e321ec8a12fd None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.386240 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c794-7631-4ad4-b327-e321ec8a12fd None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.387601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:50.392845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.393241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.393414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.410959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:50.412144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:50.420438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a459df-845f-4515-995f-d7997ed163a6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.420735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a459df-845f-4515-995f-d7997ed163a6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.421014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a459df-845f-4515-995f-d7997ed163a6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.422347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:03:50.427429 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.427717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.428002 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.467747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG passlib.handlers.bcrypt [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=221125) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 23:03:50.468164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG passlib.handlers.bcrypt [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=221125) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 23:03:50.492806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:50.514225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:50.515819 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:50.516088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:50.540538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:50.617528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:03:50.621379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcf3f-8444-4bb0-9708-023d6ff2a17a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:50.640356 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:50.656378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:50.657202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.657490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.657773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.669132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:03:50.680554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:03:50.681653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:03:50.682998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:03:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:03:50.687466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:50.742777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2b7c3-1d5e-4f6a-9251-7350afa92bb8 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:50.745103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:50.773482 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:50.780352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:50.781282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.781568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.781847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.791245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521aa45-d387-46a3-9dbf-580bfd3af4a3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:50.826119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:50.826788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.827083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.827367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.828131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:50.828470 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:50.829882 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:50.842073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:03:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:50.847565 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:50.853648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:50.855172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:50.959607 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad95838-3b69-4da9-a444-8543bde7d24a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:50.966427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:03:50.972121 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:50.974799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:50.993648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:50.994620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:50.994901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:50.995178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:50.996391 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:50.997986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:50.999607 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:03:50 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:51.005552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:51.019638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:51.072372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2124a1-b919-4046-94f8-16bb502bb734 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:51.102394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbc3bd-ed0d-4dac-ab09-b5c56f2a4b50 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:51.107460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:51.108266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:51.108589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:51.108872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:51.127659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:51.129710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:51.137226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:51.138016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:51.138299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:51.138573 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:51.139780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:51.141231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:51.142848 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:51.148667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:03:51.150975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:03:51.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:03:51.153311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:03:51.153311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:03:51.153311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:03:51.153311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:03:51.153311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:03:51.157723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:51.214288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:51.230426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:51.248983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c7f64-6527-4ac9-9feb-d08744eea8c7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:51.258468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a031ff-d366-482e-972e-b23375f6e6b1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:51.283159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:51.283818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:51.284105 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:51.284384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:51.285328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.domain.id=default, user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:51.285643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:51.287086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafb1ff-ea91-4d6f-a10d-a1a2625b7a22 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:51.291494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:51.292158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:51.292470 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:51.292750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:51.293478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:51.293792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:51.293888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 23:03:51 2022] GET /identity/v3/role_assignments?user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de&scope.domain.id=default&role.id=735ab5a0807540ac8694a65c7eac940b => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:51.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aefe63-ef1b-43e2-8042-54d64e4b8026 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:51.320525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:53.628936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eed35-b9b5-46b8-98ba-8fa1e4072db5 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:53.630025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eed35-b9b5-46b8-98ba-8fa1e4072db5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:53.630547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9eed35-b9b5-46b8-98ba-8fa1e4072db5 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:53.632148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:53.637942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:53.638352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:53.638512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:53.661602 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:53.663084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:53.766456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:53.801414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eed35-b9b5-46b8-98ba-8fa1e4072db5 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:53.940192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9eed35-b9b5-46b8-98ba-8fa1e4072db5 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:53.991551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:53.992676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:53.993118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:53.993572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.014341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-069cdbdb-f4de-4778-961f-1cc08b75a0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:03:54.022414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:03:54.023587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:54.024714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:03:54.027168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:03:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:03:54.033026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.098073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.173056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd512e8-bc5a-4ade-81cb-9ec133cdd23b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:54.234510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:54.235566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.236086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.236617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.238093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:54.238614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:54.240183 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:54.254170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92605e0-0978-482a-a662-ae77fa4d470a None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.254783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92605e0-0978-482a-a662-ae77fa4d470a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.255277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92605e0-0978-482a-a662-ae77fa4d470a None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.256898 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:54.262740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:54.267768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2e93-8163-4e67-9888-bf05d321c72a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.268144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.268716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2e93-8163-4e67-9888-bf05d321c72a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.269448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2e93-8163-4e67-9888-bf05d321c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.288757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.300858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c6fa2e93-8163-4e67-9888-bf05d321c72a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:54.303911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c6fa2e93-8163-4e67-9888-bf05d321c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:54.446413 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:54.447783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4dd2-be65-4063-802c-4fbd25c04369 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.448081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4dd2-be65-4063-802c-4fbd25c04369 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.448364 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f4dd2-be65-4063-802c-4fbd25c04369 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.456657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad057-458e-4bcb-83c2-e67f0ffc4333 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:54.458365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 16/28] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:54.459543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ae11-d368-473c-997f-5338e5e14118 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.459833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ae11-d368-473c-997f-5338e5e14118 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.460118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ae11-d368-473c-997f-5338e5e14118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.480768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.496391 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-15c7ae11-d368-473c-997f-5338e5e14118 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:54.497570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-15c7ae11-d368-473c-997f-5338e5e14118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:54.525942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:54.526847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.527133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.527414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.529470 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:54.530923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:54.533427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 13/29] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:03:54 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:54.538370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.589628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 17/30] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:54.598584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5ece-7a1f-4920-97e4-5fdcab1d6d68 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.599136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5ece-7a1f-4920-97e4-5fdcab1d6d68 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.599769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5ece-7a1f-4920-97e4-5fdcab1d6d68 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.601318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 18/31] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:54.602444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c5ece-7a1f-4920-97e4-5fdcab1d6d68 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.654270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c9372-b3c8-4f3e-aab4-9fa0a4df78e7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:54.691770 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.698220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:54.699039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.699326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.699606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.712815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:54.714743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5e552877-8b6d-4fac-bea8-25913fed823e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:03:54.740726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:03:54.741782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:03:54.742702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:03:54.742702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:03:54.742702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:03:54.742702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:03:54.742702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 14/32] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:03:54.743449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.743558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.743762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.753165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c5ece-7a1f-4920-97e4-5fdcab1d6d68 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:54.766690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:54.768565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:54.793933 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:54.795156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.795693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.796180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.797702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:54.798761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.800174 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:54.802327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 19/33] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:54.803311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.858792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 15/34] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:54.859772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:54.917004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca095b5f-15bf-4429-a9f5-52a6ac62f468 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:54.951870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:54.957188 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:54.957866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:54.958157 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:54.958438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:54.959207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:54.960622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:54.983800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165fbc3-cba4-4dc5-82bf-a8bbeab62c6b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.017977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.018576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.019392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.019680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.020427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:55.020763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.022156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.033413 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 16/35] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:55.037474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:55.054125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:55.138016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab303803-0bc2-45d2-a4f5-5e149f71e4b4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.168437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 20/36] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:03:54 2022] POST /identity/v3/roles => generated 225 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:03:55.168437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:55.182485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.183416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.183712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.184000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] PATH_INFO: `/v3/domains/default/users/7e15b0f3d7b74d6297fef6ab4fc9c8de/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.187037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.188617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8fa0-5391-402f-be09-4650c1dd3f37 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.286114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5dac0-5f98-4be7-8f8f-bad40e8b3377 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.384931 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 17/37] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jun 29 23:03:55 2022] PUT /identity/v3/domains/default/users/7e15b0f3d7b74d6297fef6ab4fc9c8de/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:03:55.386496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601ee9-bd40-49ff-be78-c28057c1040e None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.386802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601ee9-bd40-49ff-be78-c28057c1040e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.387092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b601ee9-bd40-49ff-be78-c28057c1040e None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.391864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 18/38] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:55.396326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601ee9-bd40-49ff-be78-c28057c1040e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:55.437709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.438511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.438875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.439231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.441553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.443274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a8f5d-b870-4569-90ba-6681911a8956 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.482376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:55.506331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b601ee9-bd40-49ff-be78-c28057c1040e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.519136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 21/39] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/roles => generated 219 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:03:55.530214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873eb5-8a17-4937-97d8-0d947106680b None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.530516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873eb5-8a17-4937-97d8-0d947106680b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.530808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45873eb5-8a17-4937-97d8-0d947106680b None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.532383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 22/40] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:55.533700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6e52-8de1-4f86-bf83-d18a0f203f3c None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.533700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6e52-8de1-4f86-bf83-d18a0f203f3c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.533972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a6e52-8de1-4f86-bf83-d18a0f203f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.553798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.554418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.554706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.555040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.555788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.557533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.559023 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-843a6e52-8de1-4f86-bf83-d18a0f203f3c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:55.560783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-843a6e52-8de1-4f86-bf83-d18a0f203f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:55.620513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:55.643838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:55.649186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.649186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.649186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.666647 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:55.667921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:55.675521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 19/42] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/projects => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:03:55.677939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:55.772935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 24/43] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:55.794021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:55.813381 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91650c53-9e89-4be3-91eb-a41a0ca1e523 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.845708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:55.853042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.853728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.854017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.856925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.856925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.856925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.914908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aae8f5-f180-492c-9cf3-d2f5bacd9012 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:55.930207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:55.932880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 20/44] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/roles => generated 223 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:03:55.959259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:55.960090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:55.960441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:55.960737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:55.962266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:55.963913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0d50b-d917-4a41-81ec-e08efbf2c1ae None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:55.966009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 25/45] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:03:55.972281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:56.086793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498715e2-a0a7-46d9-b9e0-1f8df0f7b5fe None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:56.123911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:56.124614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:56.124907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:56.125188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:56.125919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:56.127370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83349b93-a8a0-454d-b2ab-04b73b2029ac None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:56.318743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 21/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:03:55 2022] POST /identity/v3/projects => generated 312 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:03:57.515503 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14983ec-8d5d-468f-950b-3587aece84bd None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:57.516057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14983ec-8d5d-468f-950b-3587aece84bd None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:57.516057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14983ec-8d5d-468f-950b-3587aece84bd None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:57.517479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 26/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:57.522913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:57.523357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:57.523468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:57.540702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:57.542226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:57.576712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:57.607502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 22/48] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:57.631537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14983ec-8d5d-468f-950b-3587aece84bd None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:57.732120 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14983ec-8d5d-468f-950b-3587aece84bd None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:57.766066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:57.766797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:57.767085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:57.767367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:57.778250 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:03:57.786552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:03:57.787680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:03:57.788616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 27/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:03:57.793558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:57.890401 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86630da2-7cd4-4f21-909d-34901c5fe2f2 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:57.924003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:57.924728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:57.925022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:57.925308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:57.926076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:57.926391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:57.927799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:57.936208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 23/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:57.941655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:57.984347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:58.041409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbab2a-2d56-4b7c-a972-d3f8a9ef75ae None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:58.073720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:58.074599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.074882 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.075159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.076350 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:58.077841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:58.079502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 28/51] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:03:57 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:58.085423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:58.119500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:58.183969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5acac-6cd6-4b50-a780-20967b991a38 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:58.217455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:58.218256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.218544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.218824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.219988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:58.221478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608be6-e53e-47e6-a402-eb15e90d88b2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:58.223112 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 24/52] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:58.228872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:58.326709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd36c91-dc11-457c-b5bb-7a6136da6af5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:58.335929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:58.359838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:58.360533 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.360826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.361107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.361944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.domain.id=default, user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:03:58.362261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:58.364095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5dc5b-8654-4803-bb18-2eb68307a68e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:58.370376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 29/53] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 23:03:58 2022] GET /identity/v3/role_assignments?user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de&scope.domain.id=default&role.id=735ab5a0807540ac8694a65c7eac940b => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:58.390204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bfc7-2d93-48e7-95d3-66cba31c405b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.390546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bfc7-2d93-48e7-95d3-66cba31c405b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.390779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bfc7-2d93-48e7-95d3-66cba31c405b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.392205 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 25/54] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:03:58.398705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.398997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.399281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.425327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:03:58.426617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:03:58.497878 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 30/55] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:03:58.522396 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196bfc7-2d93-48e7-95d3-66cba31c405b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:58.631006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196bfc7-2d93-48e7-95d3-66cba31c405b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:58.632534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:58.664531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:58.665380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.665663 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.665945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.667144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:58.668629 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eafdf1-0769-443e-8287-a8211a0af4ef None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:58.670254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:03:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:03:58.676645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:03:58.774207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18271663-0dfb-4223-8dc5-2399030a8941 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:03:58.775679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:03:58.807762 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:03:58.808485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:03:58.808972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:03:58.809425 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:03:58.810449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:03:58.811896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9694291-5dc0-49ff-baac-e559a6f555df None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:03:58.888715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 23:03:58 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:00.937249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33bf0-07a3-4048-9725-184ee18b6cb6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:00.937805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33bf0-07a3-4048-9725-184ee18b6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:00.937805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd33bf0-07a3-4048-9725-184ee18b6cb6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:00.939193 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:00.944375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:00.944792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:00.944983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:00.962014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:00.963159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:01.028036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:01.052373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd33bf0-07a3-4048-9725-184ee18b6cb6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:01.151037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd33bf0-07a3-4048-9725-184ee18b6cb6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:01.184316 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:01.185128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:01.185419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:01.185700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:01.186892 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:01.188330 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b5c2e-49c5-45b7-8451-040f71082aa6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:01.189955 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:01.195126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:01.276234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:01.291669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc82b5b-362f-4398-9d32-5bf7f1021f3d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:01.324781 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:01.327180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:01.327180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:01.327180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:01.327180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:01.328185 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1ef8f-3754-4722-a9d3-22e5b726a5c6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:01.420192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:01 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:04.474751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1eb06e-9772-487f-8baf-7bde73acbd44 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.475812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1eb06e-9772-487f-8baf-7bde73acbd44 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.476319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1eb06e-9772-487f-8baf-7bde73acbd44 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.477955 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:04.483489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ec8c-cf29-4d70-b866-783570b916dc None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.484336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ec8c-cf29-4d70-b866-783570b916dc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.484877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ec8c-cf29-4d70-b866-783570b916dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.513419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-b1b1ec8c-cf29-4d70-b866-783570b916dc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:04.514991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-b1b1ec8c-cf29-4d70-b866-783570b916dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:04.609756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:04.653911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1eb06e-9772-487f-8baf-7bde73acbd44 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:04.704460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:04.782146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1eb06e-9772-487f-8baf-7bde73acbd44 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:04.784926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce2ba-d5aa-43d5-a1ee-2600d85f18f0 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.785217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce2ba-d5aa-43d5-a1ee-2600d85f18f0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.785494 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fce2ba-d5aa-43d5-a1ee-2600d85f18f0 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.787030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 35/64] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:04.791750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ccb8-e219-481d-8f6c-3c0b4ed3e62b None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.792039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ccb8-e219-481d-8f6c-3c0b4ed3e62b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.792321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0ccb8-e219-481d-8f6c-3c0b4ed3e62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.815529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-79a0ccb8-e219-481d-8f6c-3c0b4ed3e62b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:04.816778 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-79a0ccb8-e219-481d-8f6c-3c0b4ed3e62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:04.856791 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:04.857615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.857902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.858181 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.879701 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:04.895013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:04.896101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:04.897027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:04.901090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 30/65] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:04.910626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:04.939422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:04.947177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 36/66] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:04.949098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c77a-d363-4b0f-b268-a665ffd9296d None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.949397 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c77a-d363-4b0f-b268-a665ffd9296d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.950070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278c77a-d363-4b0f-b268-a665ffd9296d None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.951954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 37/67] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:04.958169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e098f4-e4bf-4d90-8810-179e4530a45f None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:04.958744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e098f4-e4bf-4d90-8810-179e4530a45f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:04.959043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e098f4-e4bf-4d90-8810-179e4530a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:04.979863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-22e098f4-e4bf-4d90-8810-179e4530a45f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:04.981851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-22e098f4-e4bf-4d90-8810-179e4530a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:05.028310 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.032716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81057-d426-4da4-a5b5-6e9777591b14 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.056959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 38/68] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:05.066052 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d0be-e7c8-4ab5-a858-9c251b4b8620 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.066356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d0be-e7c8-4ab5-a858-9c251b4b8620 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.066650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1d0be-e7c8-4ab5-a858-9c251b4b8620 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.068098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 39/69] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:05.068392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.068699 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d0be-e7c8-4ab5-a858-9c251b4b8620 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.069171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.069446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.069733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.070491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:05.070806 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.072322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a4d49-f74b-46fb-bd55-a2e732ad6f9f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.090311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 31/70] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:05.090311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.090311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.090311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.106100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:05.107303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:05.179358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 32/71] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:05.180563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.191326 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1d0be-e7c8-4ab5-a858-9c251b4b8620 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.224633 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.230717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.231548 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.231847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.232124 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.243777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:05.251635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:05.253199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:05.254115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 40/72] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:05.254884 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.289181 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.301759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85e79e-0ca3-457a-b1d4-4e80d1d2501c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.338756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.339577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.339862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.340142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.350272 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:05.356382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21841bf-6f7c-4400-9544-c023d296932d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:05.358681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:05.359780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 33/73] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:05.360686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.393498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.394382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.394674 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.394959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.408177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.409885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.411563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 41/74] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:05.416223 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.460387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.463408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca56212-cce4-4182-a986-a2ccaa9cda88 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.497331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.498138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.498430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.498716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.509835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:05.510041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dcbbd-46d7-4f47-970e-2bc06b71ebbf None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-a7fb7026-b6aa-48a6-80b3-f01d23ab8135 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:05.517651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:05.518614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:05.519559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 34/75] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:05.520288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f45bb-0bc2-45f6-a08a-88748be22fa3 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.520511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f45bb-0bc2-45f6-a08a-88748be22fa3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.520742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f45bb-0bc2-45f6-a08a-88748be22fa3 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.522027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 35/76] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:05.522741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f45bb-0bc2-45f6-a08a-88748be22fa3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.535455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.551156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.551776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.552088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.552357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.553149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:05.553468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.554879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.563106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 42/77] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:05.563902 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.628205 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f45bb-0bc2-45f6-a08a-88748be22fa3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.663044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73067f45-f3b8-4f09-9250-dbfa71c600ee None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.663409 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.664081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.664379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.664686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.665439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:05.665754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.667151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e00e6-46a0-435b-ac43-8021b114a195 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.673458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.676162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 36/78] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:05.681874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.684765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.684765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.698655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.699432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.699578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:05.699908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.700462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.700691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:05.769204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 37/79] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:05.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.770046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.771243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.772228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.867144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94920c7-0e4a-491a-82f0-e9fd9dbc10be None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:05.878079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 43/80] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:05.882957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.890184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.903964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:05.904669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:05.905030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:05.905258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:05.906015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:05.906329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:05.907722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:05.915822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 38/81] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:05.916740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:05.977942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:05.980251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f871-d7c8-440e-b809-1c7bced78199 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.014854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.015740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.016040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.016324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.017415 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cb4dd-0b14-455b-ad52-fedd28e70b86 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.017576 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.019041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.020751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 44/82] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.021528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.055888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.056801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.057092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.057372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.058595 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.060051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.061730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 39/83] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:05 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.063106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.098046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.119173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc6597-c881-4862-97a1-03e657fd4f6c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.153511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.154303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.154594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.154875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.156059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.157509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.159282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 45/84] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.159872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.162303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edca28-4ef6-4bca-b3f2-d93dbb653bdc None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.193136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.197888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.198769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.199045 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.199325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.200570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.202023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.203749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 40/85] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.205799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.262465 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c6e5e-1752-4d52-917a-e9ade239eea0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.296764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.297646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.297943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.298231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.299481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.301008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.302661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 46/86] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.303439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.303544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a868200-e33f-4ec6-b65e-89659f148b2d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.321693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.337457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.338118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.342518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.342518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.403735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.405871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.406859 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890e9fe-c9c3-4fe8-a018-db9640758c35 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.407339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.441027 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.441682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.441975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.442260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.510102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 41/87] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:06.510941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.517039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.519143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.533278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.607647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.610479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081f30b-f236-45ce-bac8-dd87a4534680 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.617516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 47/88] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:06.618178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.645750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.646427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.646718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.647003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.647719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.649209 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.718229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212f09-c4fd-4558-99a0-7df02d6c16e0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.723565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 42/89] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:06 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:06.723565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.743019 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.766239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.766930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.767222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.767566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.768683 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:06.769005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.774811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.788812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 48/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.789665 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.856198 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2883376-87fe-4701-bf9d-8936bdfdf2f6 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.902168 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.903224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.903669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.904113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.913283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f397bbf-67a6-4fb4-93cd-fa30c5047876 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:06.939584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:06.960370 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:06.961609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:06.961904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:06.962194 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:06.964883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.965618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:06.967543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 49/91] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:06.969316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:06.991481 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:06.993203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.045254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:07.114238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78e0d-d5d7-4bf5-9b0d-ab47fcb22247 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:07.122567 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 43/92] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:07.123445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:07.153456 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:07.154116 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:07.154404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:07.154685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:07.156671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:07.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.161467 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 50/93] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:06 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:07.162258 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:07.198474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:07.251828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6abfda-e7dc-4022-8ab1-92aa4a424a5d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:07.280874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5cc5-4550-4219-9ecf-7ed9fee7a6a7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:07.287582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:07.288262 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:07.288587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:07.288874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:07.289723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:07.290043 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:07.291492 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.296207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:07.300507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 44/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:07 2022] GET /identity/v3/role_assignments?user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:07.301233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:07.334050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:07.335087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:07.335378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:07.335658 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] PATH_INFO: `/v3/projects/9c0cbe6af1644301a932e6e853c359b9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:07.336947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0cbe6af1644301a932e6e853c359b9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:07.338669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.340454 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 51/95] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:07 2022] GET /identity/v3/projects/9c0cbe6af1644301a932e6e853c359b9 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:07.347634 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:07.410877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0ae75-6430-42c3-8eb8-24844374a0e5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:07.434914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:07.451929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:07.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:07.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:07.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:07.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:07.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:07.460792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbba42b-b5e4-40e1-828f-714660ad53d8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.463788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 45/96] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:07 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:07.517622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3849d-1cbc-4e2f-94b2-e76e2ab88cf7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:07.557689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:07.558379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:07.558673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:07.558964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:07.559815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=9c0cbe6af1644301a932e6e853c359b9, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:07.560141 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:07.561659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5a2cb-cc57-401b-8aab-a5d44186197a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:07.568117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 52/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:07 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=9c0cbe6af1644301a932e6e853c359b9&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:09.402248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e406c-3933-4749-9fa6-256082454dbd None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.402798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e406c-3933-4749-9fa6-256082454dbd None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.402798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e406c-3933-4749-9fa6-256082454dbd None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.404190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 46/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:09.409744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4434af-4609-405f-b771-ac7ac239e2dc None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.410160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4434af-4609-405f-b771-ac7ac239e2dc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.410337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4434af-4609-405f-b771-ac7ac239e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.437415 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-5b4434af-4609-405f-b771-ac7ac239e2dc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:09.438639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-5b4434af-4609-405f-b771-ac7ac239e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:09.488009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:09.513572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 53/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:09.536721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e406c-3933-4749-9fa6-256082454dbd None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:09.647224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e406c-3933-4749-9fa6-256082454dbd None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:09.679931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1173-3528-46ef-a088-2235ae59e4a2 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.680221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1173-3528-46ef-a088-2235ae59e4a2 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.680446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf1173-3528-46ef-a088-2235ae59e4a2 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.681853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 54/100] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:09.691157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:09.692111 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.692463 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.692754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.694757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.695047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.695327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.726416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:09.727631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:09.730523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:09.738956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:09.739932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:09.740858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 47/101] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:09.751574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:09.846477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:09.884566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 55/102] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:09.922570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae97944-2bdb-4de3-b1cc-694d20726599 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:09.938537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:09.983025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:09.983764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:09.984060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:09.984344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:09.985555 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:09.985877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:09.987888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.006341 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 48/103] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:10.012247 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.101907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bfe6d-0edb-4be2-8ff4-28fa989c87e6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.109997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.153255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.154193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.154561 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.154913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.175303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-24ad7bee-2b51-4296-984a-9c4286f8db17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:10.187572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:10.188643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:10.189554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 56/104] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:10.191353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e5df-7224-4603-a85f-2a64c917a8a7 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.191972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e5df-7224-4603-a85f-2a64c917a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.192480 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2528e5df-7224-4603-a85f-2a64c917a8a7 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.194086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 57/105] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:10.198948 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e5df-7224-4603-a85f-2a64c917a8a7 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.213025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c801db0-9476-449f-8b29-e09f38634db9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.227505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.285004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.286350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.287875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.288383 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.290711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.296942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1839-16f2-4f87-a06e-87e26a27120a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.298810 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 49/106] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:10.305157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41e0d-3f63-4f8a-8f9a-6cc647c1213a None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.305916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41e0d-3f63-4f8a-8f9a-6cc647c1213a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.306367 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41e0d-3f63-4f8a-8f9a-6cc647c1213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.336928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-19a41e0d-3f63-4f8a-8f9a-6cc647c1213a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:10.339793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-19a41e0d-3f63-4f8a-8f9a-6cc647c1213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:10.352437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2528e5df-7224-4603-a85f-2a64c917a8a7 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.396638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.398200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.399719 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.400175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.401371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:10.402984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.405080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.420302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 58/107] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:10.421833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.449322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 50/108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:10.458024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.459724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab601-021a-4d39-adf0-a79f6087bd5f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.460194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab601-021a-4d39-adf0-a79f6087bd5f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.460662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badab601-021a-4d39-adf0-a79f6087bd5f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.462342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 51/109] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:10.463251 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badab601-021a-4d39-adf0-a79f6087bd5f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.555864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09d5f2-6803-4f46-a68b-ea7418c27664 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.578067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badab601-021a-4d39-adf0-a79f6087bd5f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.580720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.594239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.595367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.595841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.596344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.597900 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.599603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f447a4-89c1-4719-88ba-eadb6ce04114 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.601907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 59/110] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:10.603401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.603841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.604294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.622343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.623259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.623535 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.623817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] PATH_INFO: `/v3/users/f7592cfd52e04fb08f920b812da645bd` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.624551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:10.625943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:10.641416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] RBAC: Authorizing `identity:get_user(user_id=f7592cfd52e04fb08f920b812da645bd)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.643180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.644957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 52/111] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/users/f7592cfd52e04fb08f920b812da645bd => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:10.645929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.700560 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 60/112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:10.709339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.742254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.764812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6a13f-4ce6-486a-b874-83abd7e676c5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.800512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.801308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.801765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.802227 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.803401 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.804883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.806515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 53/113] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:10.807428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:10.831956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020068d-1ef7-4981-9f8d-edcf4d626ee1 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.838497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:10.868385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.869315 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.869602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.869879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/489b4d6344e34e25b0feebe79fcb5456/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.871910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, user_id=489b4d6344e34e25b0feebe79fcb5456, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:10.873402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a1dd9-9bf6-47b4-ad9a-becd87fd1580 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:10.909407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c35c9-ed15-4b54-93d8-f58bdfe53e16 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:10.943287 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:10.943948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.944236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.944557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.952080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 61/114] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:10 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/489b4d6344e34e25b0feebe79fcb5456/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:10.963013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca100-da09-4a76-8fd9-003c6b9be824 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:10.963316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca100-da09-4a76-8fd9-003c6b9be824 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:10.963991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ca100-da09-4a76-8fd9-003c6b9be824 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:10.966056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 62/115] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:10.970862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ca100-da09-4a76-8fd9-003c6b9be824 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.044140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:11.045809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:11.076149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.084962 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.094786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ca100-da09-4a76-8fd9-003c6b9be824 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.138910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.140033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.140559 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.141059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.152672 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a63cb8d6-318a-41b0-bf5c-b00318f06371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:11.161477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:11.162459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:11.163331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:11.164003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 54/116] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:11.164003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.165987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 63/117] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:11.167439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49600-b1e1-4a64-be37-e1f86900e59a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49600-b1e1-4a64-be37-e1f86900e59a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.168514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd49600-b1e1-4a64-be37-e1f86900e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.186056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-bdd49600-b1e1-4a64-be37-e1f86900e59a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:11.187354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-bdd49600-b1e1-4a64-be37-e1f86900e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:11.259599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 64/118] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:11.261269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8590-0171-42a7-aa43-5444259f2dbf None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.261562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8590-0171-42a7-aa43-5444259f2dbf None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.261844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff8590-0171-42a7-aa43-5444259f2dbf None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.267286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 65/119] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:11.267286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8590-0171-42a7-aa43-5444259f2dbf None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.296617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42b1be-b43f-4ddf-9702-c5eec8a61ac2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.326879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.333506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.334178 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.334484 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.334757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.335478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:11.336976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef96fe6-1607-482b-9ad8-bb43330e7ae9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:11.351449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.375461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff8590-0171-42a7-aa43-5444259f2dbf None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.410657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e965-e620-4d8f-8330-515489778500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.411521 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e965-e620-4d8f-8330-515489778500 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.411810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e965-e620-4d8f-8330-515489778500 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.412083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e965-e620-4d8f-8330-515489778500 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.413309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e965-e620-4d8f-8330-515489778500 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:11.414885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e965-e620-4d8f-8330-515489778500 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:11.419123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 66/120] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:11.419123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e965-e620-4d8f-8330-515489778500 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.427600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 55/121] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:04:11 2022] POST /identity/v3/projects => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:11.428937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2240-1639-4772-8902-40b91383f644 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.429230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2240-1639-4772-8902-40b91383f644 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.429511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c2240-1639-4772-8902-40b91383f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.456394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-155c2240-1639-4772-8902-40b91383f644 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:11.457721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-155c2240-1639-4772-8902-40b91383f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:11.550772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 56/122] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:11.551936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2240-1639-4772-8902-40b91383f644 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.570108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e965-e620-4d8f-8330-515489778500 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.620016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.620997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.621313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.621633 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.622405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:11.622935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:11.625312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:11.635991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 67/123] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:11.636932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.651659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.703784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c2240-1639-4772-8902-40b91383f644 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.729387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.756522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.757285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.757570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.757850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.772085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:11.778727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143641c-4273-48fd-a9ce-64a3916a6347 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:11.788582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:11.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 57/124] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:11.790588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.826526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.827631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.828141 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.828773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.829907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=f7592cfd52e04fb08f920b812da645bd) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:11.831053 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:11.832922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:11.839334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 68/125] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/role_assignments?user.id=f7592cfd52e04fb08f920b812da645bd&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:11.840549 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:11.914389 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1ee5d-a31b-47c3-af93-ec9dc58849eb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:11.923616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:11.966257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:11.967707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:11.968005 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:11.968291 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:11.981884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:11.992288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:11.993400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:11.994318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 58/126] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:11.995578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.010887 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf47cdc-06d1-4d6a-a4a8-68e25249e5d9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.073312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:12.074843 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.075994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.076778 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.077015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.079458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.081230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.083404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 69/127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.084007 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.184479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694a40-03b4-40f3-bb95-bc9e55a25e76 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.257015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.257707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.257997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.258278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.259300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:12.259618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.261056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.278534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eff016-251f-44f5-9ee3-d6791c9d9d87 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.282789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 59/128] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.283508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.315370 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.316111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.316422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.316708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.317526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:12.317849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.319256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.324721 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:12.327767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 70/129] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.334451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.480768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:12.486374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6719b9-9a69-4d8d-8f79-dd46e5c8b758 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.495732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164772f-09cc-405c-b057-29ccc282dbd8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.522899 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.523787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.524074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.524354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.525598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.527144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.529061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 71/130] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.529656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.594638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.595444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.595735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.596574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.599940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:12.601133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.602609 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.604364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 60/131] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.606164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.637713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1b70a-ac64-4851-b3e0-7c282f11ef36 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.682435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.683411 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.683613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.685021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.686956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.688454 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.693672 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 72/132] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.694468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.833065 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c9bb-7669-4fa2-9f40-9e7cb23275bf None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.876489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.877344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.877632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.877911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] PATH_INFO: `/v3/projects/9c0cbe6af1644301a932e6e853c359b9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.879113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0cbe6af1644301a932e6e853c359b9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.880597 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.882592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 61/133] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/projects/9c0cbe6af1644301a932e6e853c359b9 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:12.883556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:12.916876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:12.941003 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a372bf-3ecc-4c88-b705-84f046416fef None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:12.983008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:12.983910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:12.984498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:12.984795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/7e15b0f3d7b74d6297fef6ab4fc9c8de/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:12.986923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:12.988586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:12.992195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:13.032830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6ef13-5e16-4287-b18d-0a427719ebc4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:13.069860 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:13.070846 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.071132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.071415 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.072812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:13.074338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:13.076658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 62/134] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:12 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:13.077406 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:13.094905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 73/135] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:12 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/7e15b0f3d7b74d6297fef6ab4fc9c8de/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:13.095731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:13.293116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:13.300546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67ca12-4242-428e-9feb-dd8f2efb1ba6 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:13.304275 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79135c5e-e822-491a-840a-bf7746efa4c5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:13.359310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:13.360628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.361139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.361703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/489b4d6344e34e25b0feebe79fcb5456/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.362584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:13.363497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.363782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.364061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] PATH_INFO: `/v3/projects/9c0cbe6af1644301a932e6e853c359b9/users/489b4d6344e34e25b0feebe79fcb5456/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.365341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, user_id=489b4d6344e34e25b0feebe79fcb5456, role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:13.367070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e5e8-5323-4db1-a951-501af866e3c3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:13.373351 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0cbe6af1644301a932e6e853c359b9, user_id=489b4d6344e34e25b0feebe79fcb5456, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:13.374937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:13.432113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 74/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:13 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/489b4d6344e34e25b0feebe79fcb5456/roles/07aea8814ab24e5f92f880cad751bce9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:13.434005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64fcd-7718-4003-ae80-d624d4072b47 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.434696 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64fcd-7718-4003-ae80-d624d4072b47 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.435266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af64fcd-7718-4003-ae80-d624d4072b47 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.437055 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 75/137] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:13.443256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327958a-576c-43dd-88d7-84f6e2cbe2ce None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.443844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327958a-576c-43dd-88d7-84f6e2cbe2ce None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.444378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327958a-576c-43dd-88d7-84f6e2cbe2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.465438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 63/138] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:13 2022] PUT /identity/v3/projects/9c0cbe6af1644301a932e6e853c359b9/users/489b4d6344e34e25b0feebe79fcb5456/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:13.481923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-e327958a-576c-43dd-88d7-84f6e2cbe2ce None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:13.483886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-e327958a-576c-43dd-88d7-84f6e2cbe2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:13.562453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:13.582176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 76/139] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:13.639037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:13.774485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece931c-e592-441c-b8d9-64f4146e3740 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:13.798239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825d38-ff07-4d60-b44c-ae38937c99c3 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.798239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825d38-ff07-4d60-b44c-ae38937c99c3 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.798239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76825d38-ff07-4d60-b44c-ae38937c99c3 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.798968 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 77/140] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:13.805902 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.806212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.806474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.836751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:13.837954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:13.847435 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:13.848252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:13.848574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:13.848858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:13.860046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:13.869543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:13.870579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:13.871879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 64/141] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:13.876816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:13.902787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:13.953417 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 78/142] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:13.997578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.013102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c003628-a86a-4dd1-ade8-30f2f775b996 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.085276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.085965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.086251 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.086530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.087349 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:14.087613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.089027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.105916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 65/143] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:14.112941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.173937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12400f79-dbac-4a70-a4b2-8749a3ab2092 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.203729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:14.236566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.237891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.238177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.238459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.240931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.242414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.245175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 79/144] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:14.251711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.260893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:14.297360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6db33-9b11-43c2-8c69-d04908f04aec None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.359139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.359945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.360230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.360538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.364244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.365658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.373717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 66/145] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:14 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:14.375011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.435566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc84c5f-8d72-4315-af7b-aa5bbd471c2a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.498995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.499681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.499966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.500245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.501001 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.502515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9e9ea-5771-4850-951d-ae64d2e225fb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.535708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04922c-f8a1-45ad-ad63-2bc95f4695f4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.571596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.576571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.576571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.576571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.593219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:14.644747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 80/146] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:14 2022] POST /identity/v3/users => generated 283 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:14.646134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a011-0b5e-45ea-aa7b-f60630d7c5c4 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.646436 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a011-0b5e-45ea-aa7b-f60630d7c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.646712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5a011-0b5e-45ea-aa7b-f60630d7c5c4 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.648031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 81/147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:14.653823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.655415 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.655848 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.656145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.656441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.693165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:14.694773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:14.775472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 67/148] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:14.781879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.806500 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:14.844841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:14.871261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 82/149] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:14.894658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5e63d-dde9-4248-9675-7688c609cebb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:14.915196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:14.931020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:14.932016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:14.932303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:14.932615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:14.933947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:14.935587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:14.937571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 68/150] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:14 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:14.944020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:15.052740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd60ad8-c75d-4b9f-b009-cb68847b81f3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.070562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:15.089872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.090683 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.091156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.091532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.092488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:15.092905 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:15.094467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:15.095057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf201-7cde-4032-a7ea-1e0bd7bc13fd None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.101681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 69/151] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:14 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:15.159655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.160809 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.161269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.161711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.186531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:15.195438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:15.196734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:15.197803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:15.200325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 83/152] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:15.208449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:15.342716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba2289-4dab-4b01-ba53-ac25030d414f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.387144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.387841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.388126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.388415 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.389180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:15.389491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:15.390942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:15.400449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 70/153] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:15.405611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:15.446346 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:15.532262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd20dbb-d673-416a-b88d-b5534f753e0c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.573990 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.575255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.575761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.576262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] PATH_INFO: `/v3/users/f7592cfd52e04fb08f920b812da645bd` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.577731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] RBAC: Authorizing `identity:get_user(user_id=f7592cfd52e04fb08f920b812da645bd)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:15.579511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:15.581468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 84/154] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:15 2022] GET /identity/v3/users/f7592cfd52e04fb08f920b812da645bd => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:15.588184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:15.648062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:15.713116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d740b-4470-4c39-a93a-f74486702bd1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.753949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.754833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.755111 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.755381 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.756614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:15.758075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5a1b7-6bbe-4e98-9127-37c058dca342 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:15.760365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 71/155] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:15 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:15.766169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:15.868792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:15.874098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3751fa-a945-4775-be7d-1643fcf7fb4f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:15.914060 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:15.915014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.915297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.915572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/f7592cfd52e04fb08f920b812da645bd/roles/762fa3e8009e406db8b7ba64e54766b9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.917617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, user_id=f7592cfd52e04fb08f920b812da645bd, role_id=762fa3e8009e406db8b7ba64e54766b9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:15.919132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:15.971761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1bf2-69a7-491e-a22e-bbcb580cddb4 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.971761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1bf2-69a7-491e-a22e-bbcb580cddb4 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.971761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d1bf2-69a7-491e-a22e-bbcb580cddb4 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.972106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 72/156] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:15.977742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:15.978030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:15.978311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:15.997795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 85/157] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:15 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/users/f7592cfd52e04fb08f920b812da645bd/roles/762fa3e8009e406db8b7ba64e54766b9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:16.010675 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:16.011866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:16.108752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 73/158] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:16.152676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:16.272416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c473b8d-630d-4532-9fff-42676cb3d019 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:16.313354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:16.314157 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.314438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.315247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.331168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:16.338917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:16.339925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:16.340869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 86/159] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:16.349593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:16.418408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:16.489536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316585d-97f0-4516-af99-aa1341a47f26 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:16.531258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:16.531855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.532137 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.532428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.533201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:16.533543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:16.534943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc47be-3c2d-41ee-a748-7019a96e3cc7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:16.548356 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 74/160] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:16.554524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:16.591022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:16.616733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1b9-45c9-43c2-ba63-3dc865c208eb None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.617106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1b9-45c9-43c2-ba63-3dc865c208eb None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.617303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90c1b9-45c9-43c2-ba63-3dc865c208eb None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.618865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 75/161] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:16.624817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83dae-6ce2-4ba4-ab7f-fcc832d85000 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.625097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83dae-6ce2-4ba4-ab7f-fcc832d85000 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.625379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f83dae-6ce2-4ba4-ab7f-fcc832d85000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.645621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-66f83dae-6ce2-4ba4-ab7f-fcc832d85000 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:16.647294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-66f83dae-6ce2-4ba4-ab7f-fcc832d85000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:16.730220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13739b8f-9fbb-4a73-8dd4-6f3d39a6d194 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:16.770643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 76/162] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:16.772011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a7a-587e-481e-a9f5-626501bafc2b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.772285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a7a-587e-481e-a9f5-626501bafc2b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.772592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d4a7a-587e-481e-a9f5-626501bafc2b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.773873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 77/163] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:16.782728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.782990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.783254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.819733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:16.820990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:16.826063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:16.826973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:16.827262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:16.827543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] PATH_INFO: `/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:16.828802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] RBAC: Authorizing `identity:get_user(user_id=7e15b0f3d7b74d6297fef6ab4fc9c8de)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:16.830327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:16.836537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 87/164] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:16 2022] GET /identity/v3/users/7e15b0f3d7b74d6297fef6ab4fc9c8de => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:16.837373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:16.865393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:16.941411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 78/165] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:16.942318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.025479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.058868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cbe47e-3be8-4c2a-9ac5-3879af6b38de None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.069924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e734751-9716-444f-bfb6-bdd1a8faa7f6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.106736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.107648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.108116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.108576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.141613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.142481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.143611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.144066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.144535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.168614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:17.184529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:17.186269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:17.186410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:17.187527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 88/166] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:17.191588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.315824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 79/167] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:17.317143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.382066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.417309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8898eb5-6c92-471d-860d-b53eb7a88b07 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.424244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba2f6-6308-46da-b0ff-bf896a447cd4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.460863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.461791 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.462245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.462690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.463592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:17.464059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:17.465759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:17.475087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 80/168] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:17.476085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.481951 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.482609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.482893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.483172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] PATH_INFO: `/v3/roles/member` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.508021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:17.516772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:17.523231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 89/169] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:17.524211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.536896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.592897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80c060-64f5-4dc7-af01-e1834f73a00f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.619103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.632675 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.640963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.640963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.640963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.640963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:17.640963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:17.644610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 81/170] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:17.645594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.732555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593ede7-3147-41db-8d5d-884ad223276c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.799985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.800984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.801265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.801539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.803620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:17.805221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:17.807043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 90/171] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:17.807917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.815208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f546d-c41b-499c-91a0-2cccc870b465 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:17.852585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:17.853526 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:17.853969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:17.854411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:17.855451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:17.855912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:17.857634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:17.869298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 82/172] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:17.870495 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:17.931312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.946316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:17.981981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9349f-5bd3-490a-8f15-2c2b7240bfad None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.003187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce841-7e20-43c6-83ae-c673560934b2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.023115 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.024589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.025111 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.025562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.073860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.074526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.074809 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.075083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.075920 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:18.076234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.077972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.090404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 91/173] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/role_assignments?user.id=7e15b0f3d7b74d6297fef6ab4fc9c8de&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:18.091361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:18.102864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.104626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.196880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:18.218928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 83/174] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:18.225037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:18.337869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d67996-a70c-470a-8a2a-808862418d1a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.368453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0202f-1517-479d-b174-09868f02c0f0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.376429 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.377690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.378146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.378649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.380029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.381676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.383590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 84/175] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:18 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:18.389779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:18.429841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:18.459935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.460884 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.461173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.461452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] PATH_INFO: `/v3/users/489b4d6344e34e25b0feebe79fcb5456` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.462728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] RBAC: Authorizing `identity:get_user(user_id=489b4d6344e34e25b0feebe79fcb5456)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.464208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.465994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 92/176] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:18 2022] GET /identity/v3/users/489b4d6344e34e25b0feebe79fcb5456 => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:18.477709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:18.495160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:18.502904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1ada-449b-49c4-8a2d-866fe46d0e31 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.540992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.541955 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.542459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.542921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.543909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:18.544418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.546152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.553836 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 85/177] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:18 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:18.691422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40add870-30b4-4482-b086-6b059dc4ad81 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:18.754701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:18.755379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:18.755667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:18.755948 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:18.854801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:18.856309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2609c074-4fb0-4e64-8b2a-d2e2ddc3664c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:18.865074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:18.988308 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 93/178] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:18.993672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.108787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.116882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fcbc4-a4d5-4fdb-9fdc-966c54e6b529 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.154354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.155613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.156347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.156896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] PATH_INFO: `/v3/projects/9c0cbe6af1644301a932e6e853c359b9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.158746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cc70-c55a-4acd-bdda-833e51ba981e None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.159601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0cbe6af1644301a932e6e853c359b9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:19.159861 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cc70-c55a-4acd-bdda-833e51ba981e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.160371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544cc70-c55a-4acd-bdda-833e51ba981e None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.161108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:19.162255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 94/179] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:19.167374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 86/180] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:18 2022] GET /identity/v3/projects/9c0cbe6af1644301a932e6e853c359b9 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:19.168981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720af2-2297-4666-8f97-af263347aa88 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.169501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720af2-2297-4666-8f97-af263347aa88 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.170024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36720af2-2297-4666-8f97-af263347aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.174319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.196252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-36720af2-2297-4666-8f97-af263347aa88 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:19.198080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-36720af2-2297-4666-8f97-af263347aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:19.277978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 95/181] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:19.279260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb4d8-3e15-4bd7-8753-c55b94425871 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.279552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb4d8-3e15-4bd7-8753-c55b94425871 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.279835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb4d8-3e15-4bd7-8753-c55b94425871 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.285407 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 96/182] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:19.290722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.291056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.291853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.313462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f29386-1414-4ca9-86e7-25e48e211176 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.325356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:19.326555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:19.354428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.355574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.356293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.356982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.358049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=9c0cbe6af1644301a932e6e853c359b9, user.id=489b4d6344e34e25b0feebe79fcb5456) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:19.358724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.359260 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:19.362094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:19.369466 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 87/183] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/role_assignments?user.id=489b4d6344e34e25b0feebe79fcb5456&scope.project.id=9c0cbe6af1644301a932e6e853c359b9&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:19.373773 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.401792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 97/184] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:19.402037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.437839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.539297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61918aad-6afe-4e98-b683-484521ea85d1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.585964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.586902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.587192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.587476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.600051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:19.607427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50d783-b752-4982-9439-5fc6ef681ec1 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-83a1be78-f568-4f12-94c2-beee8dbca7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:19.608500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:19.609450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:19.610365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 88/185] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:19.611328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203963e-eb0e-40f0-b3b9-f11bafba0163 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.611559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203963e-eb0e-40f0-b3b9-f11bafba0163 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.611812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203963e-eb0e-40f0-b3b9-f11bafba0163 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.613243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 89/186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:19.618010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203963e-eb0e-40f0-b3b9-f11bafba0163 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.655893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.656746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.657033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.657313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.669609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4f3e5256-05f1-45a2-aff5-dffc5b011a48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:19.679065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:19.680314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:19.681305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 98/187] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:19.682049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.682049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.682296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.701454 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:19.702672 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:19.714913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.734973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.741840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203963e-eb0e-40f0-b3b9-f11bafba0163 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.777670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.778344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.778631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.778913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.779668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:19.779982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:19.781063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 99/188] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:19.784588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679788ac-6da7-42e7-bbf9-07b00839b9bc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:19.784705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.792017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 90/189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:19.793643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512b71-eecd-4107-826e-e7f1848b0a4c None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.793938 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512b71-eecd-4107-826e-e7f1848b0a4c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.794221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f512b71-eecd-4107-826e-e7f1848b0a4c None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.796098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 91/190] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:19.797573 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f512b71-eecd-4107-826e-e7f1848b0a4c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.882368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a00f1-4505-4572-bab4-b8f3f325bec6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.898858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f512b71-eecd-4107-826e-e7f1848b0a4c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:19.917478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.918148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.918433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.918708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.919454 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:19.919765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:19.921184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28c698-7682-4061-95e7-b97139e88375 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:19.929049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 100/191] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:19.930234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.930518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.930793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.932477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:19.933454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:19.933804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:19.934087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:19.945301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:19.947178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:19.948363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:19.948659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:19.950108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:19.951803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 92/192] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:19.952589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:19.963287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.015069 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 101/193] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:20.024758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.063903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e50c78-384f-49ed-9c61-ba3fe5d7feb6 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.097497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.098325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.098621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.098895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.109181 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:20.116077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169edd2-7be7-455a-a99c-141e4fe9f9a1 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:20.117001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:20.118034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 93/194] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:20.124152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.151288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.152167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.152480 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.152762 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.153960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.155415 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.157251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 102/195] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.157934 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.174957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.186202 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.228491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e6ff3-418d-41a4-b614-8c067378bafb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc1e4d-b05f-4243-8e42-6209723e3d86 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.262100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.262750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.263042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.263321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.289852 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.290644 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.290932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.291209 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.292389 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.293866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.295488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 103/196] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.296251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.334433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.335907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.379611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.393083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.395264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ead6-83f2-433a-aab6-b414eb29dc31 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.429508 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.430182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.430476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.430868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.431519 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:20.431840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.433248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.435444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 94/197] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:20.436251 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.446373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 104/198] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.446373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.534761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e52185-15da-40b2-b672-5751d2c63acd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.541539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3e63e-bac7-4bb9-a277-7ac1c2ea9e90 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.569041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.569692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.569981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.570259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.575269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.575937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.576231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.576551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.577272 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.578727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.598258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.637018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.638536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.642617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 105/199] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:20 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:20.643511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.646236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.762488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf73b3-b614-4a52-a555-0b31d946847a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.767584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 95/200] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:20.768666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.806024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.807190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.807468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.808939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.810458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.812345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 106/201] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.816480 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.837414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.892096 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dea485-ffc6-4fa1-8e43-c2621504f14e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.901879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:20.939167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb60e7ee-9704-4969-9522-a722be89358a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:20.940072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.940992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.941281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.941621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] PATH_INFO: `/v3/users/f7592cfd52e04fb08f920b812da645bd` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.943765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] RBAC: Authorizing `identity:get_user(user_id=f7592cfd52e04fb08f920b812da645bd)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.945398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.947105 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 96/202] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/users/f7592cfd52e04fb08f920b812da645bd => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:20.983494 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:20.984490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:20.984846 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:20.985194 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:20.987295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:20.988976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:20.990810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 107/203] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:20.996316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:21.068605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c45eeb-0e9b-45c8-9034-535ebd86620a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:21.097224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:21.107114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:21.111297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:21.111297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:21.111297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:21.111297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=d91b5ea4a9f1483ea724e3453796a298) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:21.111297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:21.111692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:21.117655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 97/204] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/role_assignments?user.id=d91b5ea4a9f1483ea724e3453796a298&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:21.118611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:21.128774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0945f9-3341-4e50-9590-002d6cbb9146 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:21.172422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:21.173016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:21.173299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:21.173573 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:21.183486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:21.235944 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a76d-9ebd-44b4-9fb9-d1f353e103ff None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:21.251220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:21.252772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:21.273905 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:21.274583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:21.274920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:21.275201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:21.276044 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=d91b5ea4a9f1483ea724e3453796a298) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:21.276363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:21.277855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:21.285127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 98/205] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:21 2022] GET /identity/v3/role_assignments?user.id=d91b5ea4a9f1483ea724e3453796a298&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:21.387451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:21.394250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:21.468888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:21.517140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b96e3-0a52-4bdf-934d-618e27f100a8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:21.552610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:21.553548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:21.553833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:21.554110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:21.555353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:21.556848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0e534-7f92-4d9e-a78e-336c9a12a0a8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:21.558964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 99/207] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:21 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:21.565451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:21.605997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:21.675999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc9ec5-7840-477d-95a8-6fe2338afae1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:21.726789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:21.727696 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:21.728148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:21.728621 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:21.729645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, scope.project.id=f8e84c687f28426ea303c50b8d302a68, user.id=f7592cfd52e04fb08f920b812da645bd) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:21.730133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:21.731743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4909d05-5843-471e-965d-3bfc433ccbd3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:21.742388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 109/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:21 2022] GET /identity/v3/role_assignments?user.id=f7592cfd52e04fb08f920b812da645bd&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:22.907669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce29b8-59b7-4e32-817f-f553ca416f30 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:22.908252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce29b8-59b7-4e32-817f-f553ca416f30 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:22.908361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce29b8-59b7-4e32-817f-f553ca416f30 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:22.909847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 100/209] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:22.915204 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf99a4-8a1c-4f26-a75b-37245a45a168 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:22.915598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf99a4-8a1c-4f26-a75b-37245a45a168 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:22.915798 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf99a4-8a1c-4f26-a75b-37245a45a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:22.932663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-7fbf99a4-8a1c-4f26-a75b-37245a45a168 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:22.933853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-7fbf99a4-8a1c-4f26-a75b-37245a45a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:23.002200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 110/210] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:23.026178 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce29b8-59b7-4e32-817f-f553ca416f30 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.099390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0656-d532-4d91-994c-6f10a939857f None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.099743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0656-d532-4d91-994c-6f10a939857f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.099940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed0656-d532-4d91-994c-6f10a939857f None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.101966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 111/211] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:23.112365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.112842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.113278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.131102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:23.132348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:23.138494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce29b8-59b7-4e32-817f-f553ca416f30 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.164573 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.172262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.182764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.183685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.185559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.185559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.198601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:23.209950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:23.210976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:23.211897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:23.216175 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 101/212] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:23.220563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.227277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 112/213] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:23.253624 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.364887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dfeda-c711-4537-bab3-9075307a4b56 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.385361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbf5df-c11a-4d79-b24f-734fc7090937 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.408222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.408934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.409220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.409501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.410352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:23.410698 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:23.412146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:23.425861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 102/214] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:23.428302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.433529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.434471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.434916 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.435294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.436660 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:23.438281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:23.445939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 113/215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:23.447569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.489486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.494305 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.572618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28273185-62bf-4e46-87c9-6f027e74a663 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.583313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aee871-0586-4a7e-8a9d-d073239c2706 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.609125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.610010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.610290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.610566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] PATH_INFO: `/v3/users/9875b81d3e2e49e49854e3acdefa73d0` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.622020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.622694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.622982 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.623261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.623984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:23.624968 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] RBAC: Authorizing `identity:get_user(user_id=9875b81d3e2e49e49854e3acdefa73d0)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:23.625476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8cea6-dc8d-478d-862d-616aae295ed8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:23.626412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca300b0-b99a-49a3-8214-3b02a0a61b9e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:23.632666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 103/216] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/users/9875b81d3e2e49e49854e3acdefa73d0 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:23.632666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144fef4-efdb-490b-85f1-8c612d78dd9c None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.632666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144fef4-efdb-490b-85f1-8c612d78dd9c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.632666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144fef4-efdb-490b-85f1-8c612d78dd9c None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.635827 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 104/217] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:23.636586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144fef4-efdb-490b-85f1-8c612d78dd9c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:23.717508 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 114/218] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:23 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:23.718901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac986c-a9e9-4ce0-abe7-8efbcaddd2ca None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.719578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac986c-a9e9-4ce0-abe7-8efbcaddd2ca None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.719786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac986c-a9e9-4ce0-abe7-8efbcaddd2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.740657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-08ac986c-a9e9-4ce0-abe7-8efbcaddd2ca None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:23.741896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-08ac986c-a9e9-4ce0-abe7-8efbcaddd2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:23.748918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144fef4-efdb-490b-85f1-8c612d78dd9c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:23.750719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.789637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:23.790308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.790597 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.790880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.824200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 115/219] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:23.826119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527437-fcdb-4ee3-af73-6c65c4021f10 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.826637 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527437-fcdb-4ee3-af73-6c65c4021f10 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.827139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5527437-fcdb-4ee3-af73-6c65c4021f10 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.829052 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 116/220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:23.834501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:23.835113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:23.835615 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:23.855209 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:23.856810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:23.870145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:23.878791 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:23.880865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:23.934202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 117/221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:23.935650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.013862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 105/222] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:24.014740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.019900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.059286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfb89b-f968-499a-adeb-84e6e306c6b2 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.109871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.110605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.110891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.111231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.126067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:24.135867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4434-f6b2-4aec-8d10-4598d011504a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:24.136814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:24.137796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:24.138663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:24.139321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 118/223] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:24.141385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.155782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.186758 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.187845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.188284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.188762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.203536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:24.216457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:24.217719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:24.218809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:24.227423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 106/224] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:24.227423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.273427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640744ea-daf1-494d-98ce-4a44ffc84ad2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.300192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.318938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.320839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.321371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.321890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.323852 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.325856 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.328159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 119/225] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.329231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.345284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a117fd-9cde-4b75-acce-fb4fa58dd38a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.394150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.394741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.395026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.395301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.396058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:24.396374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.397767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.416433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 107/226] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.416433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.424727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.453331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d53b37-95dc-452c-8c4b-a8e075a8afe6 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.502288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.503583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.504565 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.504923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.505774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:24.506166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.507630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.520352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 120/227] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.520352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.605097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359259fd-1ad5-4333-8efe-548a7e18d923 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.630346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.642361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.660282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.660282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.660282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.660282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=9875b81d3e2e49e49854e3acdefa73d0) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:24.660282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.660909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.660909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 108/228] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/role_assignments?user.id=9875b81d3e2e49e49854e3acdefa73d0&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.660909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.682604 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18a218-1bbb-4d55-ac77-4fbc9c46d005 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.738874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.740243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.740704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.741157 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.742632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.744923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.749305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 121/229] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.756394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.762890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:24.845777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13549db9-4ec2-406c-9569-237800f431a3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.882182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:24.883256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:24.883929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:24.884328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:24.885665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:24.887222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:24.889347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 109/230] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:24.895669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:24.941676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6b94f-deda-4a2f-9b00-68bb9160b02a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:24.973173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:25.020181 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96748609-18e8-40eb-aa63-a01c53643e99 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:25.029113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:25.029996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:25.030568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:25.030568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:25.037159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:25.038651 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:25.040746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 122/231] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:25.048155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:25.062328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:25.063215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:25.063501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:25.063779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:25.065934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:25.067475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:25.069738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 110/232] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:24 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:25.075617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:25.189687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:25.215561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c32eb-ce55-490e-9b96-79f20f7fa185 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:25.234919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4578ff3-debf-4b9e-93fd-11356f576ef8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:25.256774 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:25.274349 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:25.275245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:25.275526 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:25.275801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/d91b5ea4a9f1483ea724e3453796a298/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:25.280330 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, user_id=d91b5ea4a9f1483ea724e3453796a298, role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:25.281812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ef97f-64a3-4984-a21d-9295ce4bfa4e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:25.292349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:25.293488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:25.293772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:25.294900 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/d91b5ea4a9f1483ea724e3453796a298/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:25.296310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, user_id=d91b5ea4a9f1483ea724e3453796a298, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:25.304135 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a609d279-9325-4a08-b09f-c79c93ae8ff6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:25.358194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 111/233] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:25 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/d91b5ea4a9f1483ea724e3453796a298/roles/07aea8814ab24e5f92f880cad751bce9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:04:25.391360 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 123/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:25 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/d91b5ea4a9f1483ea724e3453796a298/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:26.192328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4fc6-e393-489f-a67f-cc35e7562a96 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.192918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4fc6-e393-489f-a67f-cc35e7562a96 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.192918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a4fc6-e393-489f-a67f-cc35e7562a96 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.194587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 112/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:26.199676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.200073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.200259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.225370 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:26.226572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:26.230360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c09d4-64fc-46a8-b211-e9db7dc931dc None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.230661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c09d4-64fc-46a8-b211-e9db7dc931dc None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.230943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c09d4-64fc-46a8-b211-e9db7dc931dc None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.232616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 113/236] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:26.238936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.239461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.239947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.260777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:26.262558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:26.337793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 114/237] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:26.363668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:26.374077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 124/238] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:26.400717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:26.516881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:26.550740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c0278-2c59-4218-9a0d-c5569b749fb9 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:26.580888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:26.596902 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f051f-f47b-4acc-8677-660fd715a5a4 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:26.618639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:26.619496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.619781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.620057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.641749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:26.649705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:26.650668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:26.651956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 115/239] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:26.664816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:26.672876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:26.672876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.672876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.672876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.674443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:26.675923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:26.684966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 125/240] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:26.685850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:26.827980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3e85-a4b2-4c53-afc0-5f8c555a6a93 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:26.897568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f60999-db48-4deb-a4cd-449af721e3fb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:26.901631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:26.902313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.902598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.902877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.903640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:26.903953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:26.913451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:26.934438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 116/241] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:26.937283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:26.943540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:26.944500 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:26.944992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:26.948449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:26.948449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:26.948449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125035d-8a7b-450e-9ad4-f4f7f2aba944 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:26.949639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:26.992884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.031254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 126/242] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:26 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:27.077207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4893c-d6b0-4b7f-b5e4-adce3ea5e1d6 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.077842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4893c-d6b0-4b7f-b5e4-adce3ea5e1d6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.078390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4893c-d6b0-4b7f-b5e4-adce3ea5e1d6 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.079274 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4fb0a-3e5c-43b5-b126-0f142b68eb64 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.083524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 127/243] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:27.087062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.087593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.088134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.108445 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:27.111830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:27.147100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.148017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.148304 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.148624 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] PATH_INFO: `/v3/users/47f502412e314c8da761d8484a758104` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.183013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] RBAC: Authorizing `identity:get_user(user_id=47f502412e314c8da761d8484a758104)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:27.184542 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:27.186363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 117/244] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:26 2022] GET /identity/v3/users/47f502412e314c8da761d8484a758104 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:27.196825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.245614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 128/245] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:27.281815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.325002 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.332899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9db52-89a2-41d2-981c-aded47495a6a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.373786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.374460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.377469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.377963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.405217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae795d1-d7f0-411e-9ff9-8ac238e466cc None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.423937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.449989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.450872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.451146 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.451426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] PATH_INFO: `/v3/roles/member` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.466715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:27.474722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:27.475540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:27.476757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:27.477677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:27.478340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:27.480101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 129/246] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:27.490668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.601548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.609507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 118/247] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:27.616037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.620656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3539-441e-4157-b4d5-781f2d46020a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.676850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.677860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.678324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.678772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.679709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] RBAC: Adding query filter params (name=member) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:27.680175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:27.681752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:27.691555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 130/248] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:27.697471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.733665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8a0e6-bdc9-4706-89e8-3d4201ef2e0d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.755140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.775970 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.776895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.777178 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.777455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.778669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:27.780137 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:27.782201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 119/249] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:27.789362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.845417 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c4fe1-ba76-4efa-86ca-bf494ff0f622 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:27.914165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:27.914970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:27.915256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:27.915540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] PATH_INFO: `/v3/users/9875b81d3e2e49e49854e3acdefa73d0` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:27.919988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:27.921160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] RBAC: Authorizing `identity:get_user(user_id=9875b81d3e2e49e49854e3acdefa73d0)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:27.922638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:27.925254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 131/250] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/users/9875b81d3e2e49e49854e3acdefa73d0 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:27.957720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:27.965714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f5a33-823e-40bd-b836-87a2872f2559 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.002020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.002760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.003076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.003430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.004270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=47f502412e314c8da761d8484a758104) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:28.004610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:28.006257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab841a-70c5-4a40-85bd-a3d1f80cedab None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:28.012626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 120/251] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/role_assignments?user.id=47f502412e314c8da761d8484a758104&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:28.019927 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed640c-f865-47c2-a318-0429870d481e None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.020252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed640c-f865-47c2-a318-0429870d481e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.020534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed640c-f865-47c2-a318-0429870d481e None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.021972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 121/252] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:28.037510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e354-d01d-4e45-bdcd-9c3aa2f24e9d None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.037875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e354-d01d-4e45-bdcd-9c3aa2f24e9d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.038294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95e354-d01d-4e45-bdcd-9c3aa2f24e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.071991 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-9a95e354-d01d-4e45-bdcd-9c3aa2f24e9d None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:28.073463 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-9a95e354-d01d-4e45-bdcd-9c3aa2f24e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:28.169869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a1ee5-d81a-4956-a049-4771106b1682 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.175352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 122/253] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:28.176758 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53ee-b76f-4ac9-9be2-f4d3b40c2639 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.177048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53ee-b76f-4ac9-9be2-f4d3b40c2639 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.177324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e53ee-b76f-4ac9-9be2-f4d3b40c2639 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.178646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 123/254] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:28.183293 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:28.186268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.186557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.186831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.212076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:28.213312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:28.237763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.238944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.239389 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.239886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.242184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:28.244503 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:28.247813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 132/255] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:27 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:28.249644 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.285264 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:28.305606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:28.307192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.427252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c5552-9127-452a-9e2f-f3a5f4846096 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.446477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c331-3948-4856-b95c-42b83bc49e44 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.473317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.475192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.475192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.475192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/9875b81d3e2e49e49854e3acdefa73d0/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.481631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, user_id=9875b81d3e2e49e49854e3acdefa73d0, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:28.483388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:28.503528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.509656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.509656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.509656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.517924 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:28.526623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:28.527648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:28.528593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:28.531088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 133/257] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:28.532192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.570060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 125/258] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:28 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/9875b81d3e2e49e49854e3acdefa73d0/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:28.571222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.604104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:28.700517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074a6fc-0daa-4863-ac28-21a8a3c2a4a1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.714893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:28.778310 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d6454-48b6-4249-8a1d-3a0e48ef21d5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.818936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.819906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.820361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.820832 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.821886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:28.822370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:28.823910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:28.824710 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:28.825685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:28.825986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:28.826357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:28.834460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 126/259] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:28.840210 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.862927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:28.870811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:28.871907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:28.872870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:28.878413 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 134/260] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:28.879373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:28.957865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78165b48-053a-466f-a7a2-e0abc7f9c75f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:28.968825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.013985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.015272 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.015748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.016215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.019257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.021134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.024822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 127/261] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:28 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:29.036186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.076163 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.087380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1644-a012-4258-8ed8-0275814c3dbf None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.127820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.128587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.128883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.129225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.130305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:29.130626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.132222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.144331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 135/262] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:29.150053 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.211677 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdb54-dc43-4dfd-8ded-ae61fcd2cf58 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.282684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.283354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.283622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.283903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.318162 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba1e8b-9501-4e08-b46e-5b5bb9251d57 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.371806 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.389981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.395303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.395303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.395303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] PATH_INFO: `/v3/users/d91b5ea4a9f1483ea724e3453796a298` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.395303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b5ea4a9f1483ea724e3453796a298)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.395303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.396543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 136/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/users/d91b5ea4a9f1483ea724e3453796a298 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:29.412711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.414194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.418050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.465462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.533593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 128/264] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:29.554240 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.571324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22d37-d076-46ad-a42d-1ebd720602c2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.608604 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.609365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.609728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.683820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.685517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.685999 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.715557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4bfd-2a63-4a47-b941-1eb5c54c656d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.721642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.786007 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.786890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.787175 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.787450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.788670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.790118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.792144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:29.797730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 137/266] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:29.803875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.804428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:29.912302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02c35a-62ca-4eb4-b2ca-9b07f52c7eae None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:29.940775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:29.951788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827437e6-648b-4001-801f-ae672d491340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:29.956671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827437e6-648b-4001-801f-ae672d491340 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:29.956671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827437e6-648b-4001-801f-ae672d491340 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:29.956671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827437e6-648b-4001-801f-ae672d491340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:29.956671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827437e6-648b-4001-801f-ae672d491340 None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=d91b5ea4a9f1483ea724e3453796a298) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:29.956671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827437e6-648b-4001-801f-ae672d491340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:29.957043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827437e6-648b-4001-801f-ae672d491340 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:29.962993 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 138/267] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/role_assignments?user.id=d91b5ea4a9f1483ea724e3453796a298&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:30.040654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822068-1976-4518-9ebc-6676f78193d2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:30.092160 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:30.093483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.093987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.094491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.101372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:30.103235 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d23c58-a0ad-4edb-8bdb-46b81875b549 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:30.105417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 130/268] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:29 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:30.111628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827437e6-648b-4001-801f-ae672d491340 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:30.135975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33525-30a4-42b5-b9bb-5ea4b9a1f624 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.136665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33525-30a4-42b5-b9bb-5ea4b9a1f624 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.137177 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df33525-30a4-42b5-b9bb-5ea4b9a1f624 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.139079 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 131/269] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:30.145646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.146225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.146854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.170159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:30.172637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:30.187759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:30.262626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 132/270] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:30.310211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:30.327675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827437e6-648b-4001-801f-ae672d491340 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:30.394625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:30.395667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.397077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.397077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.397965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=d91b5ea4a9f1483ea724e3453796a298) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:30.398290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:30.399762 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:30.408198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 139/271] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:30 2022] GET /identity/v3/role_assignments?user.id=d91b5ea4a9f1483ea724e3453796a298&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:30.463691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad6606d-beb0-422c-9550-44a647b3cfdd None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:30.506661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:30.507867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.508363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.509133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.510553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:30.512218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb31d42-3d2b-4273-afe3-17c0a1e3da9f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:30.514391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 133/272] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:30.522478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:30.578030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fc50-652d-4920-9772-c6de63f368f5 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.578691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fc50-652d-4920-9772-c6de63f368f5 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.580028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063fc50-652d-4920-9772-c6de63f368f5 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.581899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 134/273] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:30.588369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.588369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.588676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.619504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:30.620761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:30.632613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:30.632942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:30.695461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d26a3-9080-4d54-8416-13834a759b99 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:30.727471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 135/274] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:30.731712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:30.732386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.732700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.732977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.733698 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:30.735162 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139189c0-172c-4e2a-b3b2-af51d5e12324 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:30.749486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:30.837813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 140/275] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:30 2022] POST /identity/v3/users => generated 293 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:30.866492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0960-eff0-417b-a5e7-123759d3700f None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.867295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0960-eff0-417b-a5e7-123759d3700f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.867647 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0960-eff0-417b-a5e7-123759d3700f None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.870305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 141/276] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:30.876172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.877111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.877362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.878146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d8731-8ea0-4df2-9217-ea3a41d6c6f2 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:30.899547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:30.900882 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:30.917328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:30.918149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:30.918444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:30.918766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:30.928997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:30.932508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:30.941783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:30.943173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:30.944102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 136/277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:30.949609 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:30.989770 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 142/278] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:31.014292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.061318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:31.078585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dd48d-f655-4495-9fef-d460b55a89af None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.121830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.122034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.122270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.122486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.123243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:31.123558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.127278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.134672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 137/279] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:31.141449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.147698 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6869c-8629-4714-bd54-f105c333ddfd None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.202291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.202291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.202291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.202291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.214014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:31.215669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:31.223731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:31.224972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:31.225903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 143/280] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:31.230912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.271352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34e3fd-b7a5-4ca9-99e6-a2f6c208cb69 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.322616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.324191 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.324660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.325097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] PATH_INFO: `/v3/users/991289986b634a719e45e83fd2d1c0a4` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.340662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] RBAC: Authorizing `identity:get_user(user_id=991289986b634a719e45e83fd2d1c0a4)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.342461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.344747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 138/281] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/users/991289986b634a719e45e83fd2d1c0a4 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:31.351100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.360017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:31.365314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32b10b-b4cf-4f97-8c14-a4481899b26c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.405709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.406307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.406596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.406881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.408176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:31.408515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.409906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.419814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 144/282] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:31.426222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.461661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c943e06-e6bc-4e44-a6ff-5fb59bc161ca None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.483923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:31.499140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.500147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.500726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.501281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.502404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, user.id=991289986b634a719e45e83fd2d1c0a4, scope.system=all) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:31.502956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.504662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.510570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 139/283] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/role_assignments?user.id=991289986b634a719e45e83fd2d1c0a4&scope.system=all&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:31.542183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dc56d-8dbb-4f90-a94e-a0f2fbe8e662 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.583758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.584745 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.585033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.585318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] PATH_INFO: `/v3/users/47f502412e314c8da761d8484a758104` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.586616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] RBAC: Authorizing `identity:get_user(user_id=47f502412e314c8da761d8484a758104)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.588113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.590194 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 145/284] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/users/47f502412e314c8da761d8484a758104 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:31.596770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.706440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0301-efbf-4021-ad2b-7e05bfe7a7a2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.748632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.749561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.749858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.750139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.751411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.753023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331c791-9d08-4610-8775-3d75b22635e8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:31.754765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 140/285] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:31 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:31.761489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:31.803870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:31.904238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad568b-c089-43aa-ad76-ef330a428803 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:31.940523 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:31.941476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:31.941763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:31.942041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/47f502412e314c8da761d8484a758104/roles/762fa3e8009e406db8b7ba64e54766b9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:31.944060 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, user_id=47f502412e314c8da761d8484a758104, role_id=762fa3e8009e406db8b7ba64e54766b9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:31.945551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc196-9b3e-4215-84b9-0c8f9adba3a0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:32.027385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 146/286] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:04:31 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/users/47f502412e314c8da761d8484a758104/roles/762fa3e8009e406db8b7ba64e54766b9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:32.072771 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03049-b01b-4283-8cc6-61c15eb09dd8 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.073116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03049-b01b-4283-8cc6-61c15eb09dd8 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.073342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03049-b01b-4283-8cc6-61c15eb09dd8 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:32.075062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 141/287] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:32.080752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.081065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.081330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:32.099568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:32.100837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:32.178096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 147/288] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:32.202936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03049-b01b-4283-8cc6-61c15eb09dd8 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:32.265596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:32.321708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03049-b01b-4283-8cc6-61c15eb09dd8 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:32.359017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:32.359885 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.360176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.360510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:32.371612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:32.379845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:32.380967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:32.382740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 142/289] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:32.389690 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:32.413611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:32.494918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae425a2f-ca82-46c5-8daa-cd634ae2259a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:32.533021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:32.533816 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.534113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.534392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:32.535175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] RBAC: Adding query filter params (name=member) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:32.535489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:32.536977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:32.547461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 148/290] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:32.553040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:32.683417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60e90-c91e-4458-bb7d-6cf3f3d8c6d3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:32.697402 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:32.723896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:32.724871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.725164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.725453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] PATH_INFO: `/v3/users/9875b81d3e2e49e49854e3acdefa73d0` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:32.726674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] RBAC: Authorizing `identity:get_user(user_id=9875b81d3e2e49e49854e3acdefa73d0)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:32.728124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:32.729878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 143/291] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:32 2022] GET /identity/v3/users/9875b81d3e2e49e49854e3acdefa73d0 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:32.735441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:32.862538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:32.888994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82670c3-bae4-4c1e-bfde-eb979df7625a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:32.934529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:32.935104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:32.935394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:32.935679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.008027 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:33.009832 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:33.117184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:33.137739 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 149/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:33.143460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:33.264322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec64ff3-ed19-41fd-98a1-fcf1753a20a2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:33.306072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:33.306953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.307242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.307522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.308752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:33.310196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aeeaf-edcf-4b57-95c3-b7fc6dba1d76 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:33.312100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 144/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:33 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:33.318613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:33.439538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d373e3-c4db-4feb-ac99-28d0a25e0ec8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:33.481913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:33.482650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.484842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.484842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.484842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=9875b81d3e2e49e49854e3acdefa73d0) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:33.484842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:33.486517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c71f1f-5310-407d-9fdb-38b29d44dc0b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:33.493372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 150/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:33 2022] GET /identity/v3/role_assignments?user.id=9875b81d3e2e49e49854e3acdefa73d0&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:33.628297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76604f-16b9-46e7-b990-87e98329df69 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.628897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76604f-16b9-46e7-b990-87e98329df69 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.628985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76604f-16b9-46e7-b990-87e98329df69 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.630752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 145/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:33.636870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649877-6af4-4665-b064-7c7aba9b3b3e None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.637205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649877-6af4-4665-b064-7c7aba9b3b3e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.637450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8649877-6af4-4665-b064-7c7aba9b3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.655520 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a8649877-6af4-4665-b064-7c7aba9b3b3e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:33.656788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a8649877-6af4-4665-b064-7c7aba9b3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:33.701317 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:33.730183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 151/296] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:33.754528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76604f-16b9-46e7-b990-87e98329df69 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:33.798289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f616-5d09-4654-9e22-d8607d3c05d4 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.798634 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f616-5d09-4654-9e22-d8607d3c05d4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.798858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162f616-5d09-4654-9e22-d8607d3c05d4 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.800267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 152/297] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:33.807562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.807873 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.808139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.815688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:33.826625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:33.827814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:33.889546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76604f-16b9-46e7-b990-87e98329df69 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:33.914403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 153/298] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:33.932641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:33.933453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:33.933740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:33.934022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:33.935215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:33.936691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:33.938339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 146/299] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:33.940692 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:33.944554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.068593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f38d10-8e95-46da-b944-2a0a5a4be4f4 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.074605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29d620-fd6d-4bb9-b79f-ca91c808244e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.076772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.092250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.104755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.105564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.105864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.106143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.110838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.111512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.111799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.112091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] PATH_INFO: `/v3/groups` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.112804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.114300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af5eae-423e-4825-a775-31d48f80c07a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.118450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a8ad5bbd-fc7c-4d31-b93e-cf98b8508c3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:34.126953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:34.128142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:34.129114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 154/300] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:34.129885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433736aa-319e-41e1-a00a-2dca80216892 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.129885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433736aa-319e-41e1-a00a-2dca80216892 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.130027 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433736aa-319e-41e1-a00a-2dca80216892 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.131296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 155/301] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:34.133965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433736aa-319e-41e1-a00a-2dca80216892 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.204908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 147/302] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 23:04:33 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:34.204908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.204908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.204908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.234377 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:34.236631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:34.247018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433736aa-319e-41e1-a00a-2dca80216892 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.287433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.288125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.288426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.288714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.289490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:34.289803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.291299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.306367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 156/303] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:34.307379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.340430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 148/304] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:34.348473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.363749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.449025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bf9ef-a0d0-4690-a002-c5de252e27db None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.494671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.495256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdafd956-89d9-4c29-9b8a-f667fe3a9e3f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.495737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.496128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.496531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] PATH_INFO: `/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.506425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.515407 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbf75eb97dc48dcb279ea066ae5a61c)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.517864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.520214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 157/305] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:34.525972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.541120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.542234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.542747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.543243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.555047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:34.564388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:34.565456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:34.566357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:34.567734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 149/306] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:34.573155 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.684230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.702375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60484d4d-aca1-4482-975e-d31c4e93e285 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.709695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645b9df-c16e-4f83-accb-df192137a4ba None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.743213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.743880 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.744169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.744479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.745376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, user.id=6dbf75eb97dc48dcb279ea066ae5a61c, scope.system=all) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:34.745639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.747169 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.747298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d751c-4916-4174-b04e-2d843436695a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.747724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.748009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.748289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.752616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:34.752616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.752616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.756602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 158/307] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/role_assignments?user.id=6dbf75eb97dc48dcb279ea066ae5a61c&scope.system=all&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:34.757715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506afcb-dc00-4e34-bbd5-57ababdfdb48 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.758007 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506afcb-dc00-4e34-bbd5-57ababdfdb48 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.758291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506afcb-dc00-4e34-bbd5-57ababdfdb48 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.760190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 159/308] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:34.766599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.766599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.766599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.767037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 150/309] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:34.771740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.785089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:34.786622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:34.804230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:34.884433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 160/310] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:34.895089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337af4-8d75-4e05-829b-5a844b428b35 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:34.903867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.943110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:34.944006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:34.944396 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:34.944706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] PATH_INFO: `/v3/users/991289986b634a719e45e83fd2d1c0a4` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:34.946030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] RBAC: Authorizing `identity:get_user(user_id=991289986b634a719e45e83fd2d1c0a4)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:34.947577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:34.949838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 151/311] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/users/991289986b634a719e45e83fd2d1c0a4 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:34.956257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:34.994873 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:35.017521 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb55551-587a-47c5-9818-2a30a1b61026 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.054323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.055136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.055421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.055703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.062394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:35.066654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:35.069870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50284-8b25-4dfb-a92d-d2d28d9864e3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:35.078949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:35.080167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:35.081333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 161/312] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:35.085429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:35.114092 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.115215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.115658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.116094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] PATH_INFO: `/v3/system/users/991289986b634a719e45e83fd2d1c0a4/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.117834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=991289986b634a719e45e83fd2d1c0a4, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:35.119399 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:35.196815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 152/313] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 23:04:34 2022] PUT /identity/v3/system/users/991289986b634a719e45e83fd2d1c0a4/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:35.204592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4f89c-5933-48bd-8807-bfb0b635db96 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.246916 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.247170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.247418 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.247690 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.248529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:35.248841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:35.250294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:35.256797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:35.266364 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 162/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:35.268598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:35.382965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3424da-fd85-4083-bf3c-e2c31a66a3b4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.422778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.423724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.424003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.424276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] PATH_INFO: `/v3/users/47f502412e314c8da761d8484a758104` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.425592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] RBAC: Authorizing `identity:get_user(user_id=47f502412e314c8da761d8484a758104)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:35.427068 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:35.432527 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 153/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:35 2022] GET /identity/v3/users/47f502412e314c8da761d8484a758104 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:35.434775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:35.541901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f04fb-fb92-4323-9a19-454da25bd570 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.576531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.577188 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.577474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.577754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.647251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:35.649445 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:35.650923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:35.752160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 163/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:35.757764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:35.789644 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:35.864483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348d688-a924-4fe0-bac7-e50d00df9539 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:35.903899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:35.904812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:35.905101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:35.905380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:35.906582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:35.908081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57323081-db1b-4d3b-9341-add086d310eb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:35.910163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 154/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:35 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:35.917537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:36.028854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:36.031255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65150-a6ef-4b6f-87de-0b6f8e79d0b9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:36.068565 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:36.069231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.069519 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.069801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.070639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f, user.id=47f502412e314c8da761d8484a758104) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:36.070960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:36.072432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b7740-1a76-457a-ad44-1ad50eae8e1b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:36.079133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 164/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:04:35 2022] GET /identity/v3/role_assignments?user.id=47f502412e314c8da761d8484a758104&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:36.377404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815999cd-ffed-436e-a3d8-a312953145fa None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.377795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815999cd-ffed-436e-a3d8-a312953145fa None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.377979 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815999cd-ffed-436e-a3d8-a312953145fa None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.379624 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 155/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:36.385553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.385861 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.386101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.403001 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:36.404191 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:36.473225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 165/320] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:36.496638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815999cd-ffed-436e-a3d8-a312953145fa None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:36.591702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:36.599516 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815999cd-ffed-436e-a3d8-a312953145fa None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:36.633493 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:36.634520 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.634805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.635091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.636256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:36.637844 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5baf1-e708-4c12-a07c-02f745aa47f5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:36.639728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 156/321] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:36.645111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:36.744234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:36.750727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e752ea5-0a27-47f6-9355-5af5764a649f None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:36.786119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:36.786786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.787067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.787343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] PATH_INFO: `/v3/groups` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.788046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:36.789580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c70c3-69db-4952-ad30-693f79395ac6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:36.896518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 166/322] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 23:04:36 2022] POST /identity/v3/groups => generated 226 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:36.955479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904751-5ff5-4604-974e-00cb9e020842 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.956038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904751-5ff5-4604-974e-00cb9e020842 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.956038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904751-5ff5-4604-974e-00cb9e020842 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.957735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 157/323] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:36.963379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:36.963677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:36.963955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:36.983243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:36.984483 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:37.059133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 167/324] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:37.083023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3904751-5ff5-4604-974e-00cb9e020842 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.193906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3904751-5ff5-4604-974e-00cb9e020842 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.231214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.232023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.232302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.232656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.244065 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-96286142-76e1-4b14-88a7-250d8fb0bf9f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:37.252674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:37.253685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:37.254589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:37.263595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.340558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7fa-ad8a-4ca2-8189-37ab95dfa9b2 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.341100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7fa-ad8a-4ca2-8189-37ab95dfa9b2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.341388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e7fa-ad8a-4ca2-8189-37ab95dfa9b2 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.342923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 159/326] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:37.348621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.348921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.349201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.362211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:37.379208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:37.380718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cc8a3-c738-40ae-8fa5-b24710453da6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.381289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:37.416168 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:37.420765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.420765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.421438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.421438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.422041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:37.422352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:37.423801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:37.433205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 168/327] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:37.439056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.479550 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 160/328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:37.509694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.571283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca0bc-3059-4fb4-8eef-ff73d78179d4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.614685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.616036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.616595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.619361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] PATH_INFO: `/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.621106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbf75eb97dc48dcb279ea066ae5a61c)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:37.622989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:37.625412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 169/329] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:37.631372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.634283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c72b2-0823-4099-a884-3137e3a763d2 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.654217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:37.679251 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.680091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.680613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.680904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.694428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:37.706363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:37.707479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:37.708498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 161/330] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:37.716165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.738913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:37.777284 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba5b23-47dd-4908-baa0-d3774f7d11c3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.818717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.820092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.820662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.821181 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] PATH_INFO: `/v3/system/users/6dbf75eb97dc48dcb279ea066ae5a61c/roles/762fa3e8009e406db8b7ba64e54766b9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.823082 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6dbf75eb97dc48dcb279ea066ae5a61c, role_id=762fa3e8009e406db8b7ba64e54766b9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:37.824751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:37.847884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb259f-52ec-4ff2-9249-659768afd30d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:37.885342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:37.886017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:37.886348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:37.886635 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:37.887383 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:37.887691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:37.889105 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:37.899093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 162/331] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:37.904468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:37.906757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 170/332] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 23:04:37 2022] PUT /identity/v3/system/users/6dbf75eb97dc48dcb279ea066ae5a61c/roles/762fa3e8009e406db8b7ba64e54766b9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:37.992571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:38.017649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838247-da92-409d-9c91-fab28481cfd0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:38.056021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336e941-2530-4109-b807-641985577d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:38.056990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e941-2530-4109-b807-641985577d19 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:38.057280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e941-2530-4109-b807-641985577d19 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:38.057556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336e941-2530-4109-b807-641985577d19 None admin] PATH_INFO: `/v3/users/991289986b634a719e45e83fd2d1c0a4` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:38.058785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336e941-2530-4109-b807-641985577d19 None admin] RBAC: Authorizing `identity:get_user(user_id=991289986b634a719e45e83fd2d1c0a4)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:38.060329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336e941-2530-4109-b807-641985577d19 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:38.062514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 163/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:37 2022] GET /identity/v3/users/991289986b634a719e45e83fd2d1c0a4 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:38.068907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:38.192868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:38.218438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a223e-8b05-43f7-8676-2bf5de4deaf1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:38.272595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:38.273196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:38.273487 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:38.273782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:38.274631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] RBAC: Adding query filter params (role.id=7dc95c4d58004997b44d6ac89f699a19, user.id=991289986b634a719e45e83fd2d1c0a4, scope.system=all) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:38.274954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:38.276555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20337f0-4dcb-4692-a91e-43438cbb6f7b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:38.293251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 171/334] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:04:38 2022] GET /identity/v3/role_assignments?user.id=991289986b634a719e45e83fd2d1c0a4&scope.system=all&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:39.429021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a671-d5b6-4252-9460-6c8965886d9b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:39.430235 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a671-d5b6-4252-9460-6c8965886d9b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:39.430730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40a671-d5b6-4252-9460-6c8965886d9b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:39.432612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 164/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:39.439033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982592-2fd3-435e-a4ef-8943ce529a16 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:39.439846 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982592-2fd3-435e-a4ef-8943ce529a16 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:39.440348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96982592-2fd3-435e-a4ef-8943ce529a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:39.463775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-96982592-2fd3-435e-a4ef-8943ce529a16 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:39.465498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-96982592-2fd3-435e-a4ef-8943ce529a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:39.548564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 172/336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:39.574313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a671-d5b6-4252-9460-6c8965886d9b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:39.607424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb9e3-79aa-46ac-b9c0-b72e8d925ae6 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:39.608026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb9e3-79aa-46ac-b9c0-b72e8d925ae6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:39.608517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb9e3-79aa-46ac-b9c0-b72e8d925ae6 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:39.610486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 173/337] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:39.615404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:39.615915 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:39.616397 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:39.649437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:39.650650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:39.714417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40a671-d5b6-4252-9460-6c8965886d9b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:39.757876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:39.759072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:39.759358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:39.759638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:39.781329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:39.789390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:39.790346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:39.791664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 165/338] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:39.798174 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:39.802539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:39.808153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 174/339] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:39.814258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:39.879640 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.026668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d56b8-40f4-4733-a35b-fa7c75c352ef None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.028226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207468-28fc-441c-abe8-a51e7ee6cf7d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.087416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.088250 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.088571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.088855 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.110895 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:40.124342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:40.125420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:40.127002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 175/340] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:40.131423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.137643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.138683 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.139664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.140649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:40.141164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:40.142943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:40.162540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 166/341] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:40.164364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.201662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:40.246793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:40.266387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03ecc-85e0-429f-9bc8-75b74714a91c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.293276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cdaa3-7e96-4ed9-8b1a-c531ee3dabce None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.321268 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.323819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.324749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.325630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.328095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:40.329186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:40.330810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:40.332641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.334835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.335346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.335825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.352858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 176/342] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:40.357921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.478359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:40.480622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0212e-4c41-4717-b298-dd65ffcc8cb4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:40.547315 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8b576-ef0c-4753-8d50-c8ff1ff3af59 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.567737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:40.591692 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.592738 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.593215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.593675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.644805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:40.681501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:40.684094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a543ab-e5f7-4242-9efb-b923d4861148 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:40.730869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 167/343] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:40.732620 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283092-c281-4cad-92bb-63b0a2494756 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.733060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283092-c281-4cad-92bb-63b0a2494756 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.733507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283092-c281-4cad-92bb-63b0a2494756 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.734940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 168/344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:40.739285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283092-c281-4cad-92bb-63b0a2494756 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.821570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 177/345] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:40.823542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.824109 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.824514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.846349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:40.847623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:40.868755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:40.942511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283092-c281-4cad-92bb-63b0a2494756 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:40.968118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 178/346] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:40.969042 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:40.983032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:40.983908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:40.984189 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:40.984517 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:40.985796 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:40.987295 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:40.992027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 169/347] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:40.994924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.034425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:41.106316 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4bae1-8508-46bf-a42d-f8b7258effff None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.144642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.145583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.146051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.146467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.152862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.154309 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.160513 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 170/348] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.161371 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.169855 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a6872-2d56-4786-b70e-3a775568e839 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.222694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.223580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.223864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.224144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.227550 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.229096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.230849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 179/349] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:40 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.231625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.261973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:41.292575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec7bc-d249-44b7-b952-ba8344c877d8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.304812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:41.329545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.330411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.330699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.330978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.343372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:41.353876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:41.356149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 171/350] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:41.357865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.411450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f56ec-285c-4f4e-ae5f-54c118d62c71 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.467830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542eaa3-f2bb-4def-a88a-5e841cc2fd47 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.485663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.486350 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.486635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.486911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.487758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=f8e84c687f28426ea303c50b8d302a68) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:41.488075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.489575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.506290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.507167 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.507449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.507939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.509432 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.510593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 180/351] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.511264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.517271 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.519218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 172/352] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.526012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.620939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:41.671642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:41.696506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacc340-7825-440e-8a27-688a05ac25a9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.746773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9104a-04ca-4bb2-8bbc-a943d1c1583e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:41.748143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.748872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.749156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.749456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.752426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=f8e84c687f28426ea303c50b8d302a68) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:41.752426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.752657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac65de-935e-442c-8fa1-a0a6762277bd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.761940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 173/353] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.762778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50297c-be08-4b84-888c-8521846f3a08 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.763072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50297c-be08-4b84-888c-8521846f3a08 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.763353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50297c-be08-4b84-888c-8521846f3a08 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.764861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 174/354] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:41.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.772211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.772492 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.799407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:41.800706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:41.850591 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:41.851706 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.852190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.852698 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.853671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] RBAC: Adding query filter params (name=member) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:41.854187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:41.855590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579429b-5cd3-43fc-9c51-c2f7ac3bbf86 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:41.872460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 181/355] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:41.873743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa112ad-94ea-43b0-b7ca-32920ec024a9 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.874035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa112ad-94ea-43b0-b7ca-32920ec024a9 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.874317 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa112ad-94ea-43b0-b7ca-32920ec024a9 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.879569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 182/356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:41.881391 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0506e-d8ba-4c87-b838-b6237a6a12d3 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:41.881680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0506e-d8ba-4c87-b838-b6237a6a12d3 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:41.881982 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0506e-d8ba-4c87-b838-b6237a6a12d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:41.892200 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 175/357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:41.893569 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:41.925556 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-dcf0506e-d8ba-4c87-b838-b6237a6a12d3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:41.926785 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-dcf0506e-d8ba-4c87-b838-b6237a6a12d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:41.931319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.042675 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd83-b779-41cc-8aa4-28afae4f9e32 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.043096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 183/358] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:42.048904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbbf-16ba-47d5-9c61-4b27b3d1ea91 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.049486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbbf-16ba-47d5-9c61-4b27b3d1ea91 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.049973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0dbbf-16ba-47d5-9c61-4b27b3d1ea91 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.052002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 184/359] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:42.053013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0dbbf-16ba-47d5-9c61-4b27b3d1ea91 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.079700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.080368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.080693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.080975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.157569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.170621 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0dbbf-16ba-47d5-9c61-4b27b3d1ea91 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.180149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:42.180149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:42.200910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.212381 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.213332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.213771 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.214287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.226658 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-9546b4bd-41d0-4a63-b110-2bcf19b7d9a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:42.235354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:42.236609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:42.237585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 185/360] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:42.238332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.238332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.238332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.268299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:42.269547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:42.320576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 176/361] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:42.321455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.360505 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 186/362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:42.361533 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.431943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.473117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b1cd-1233-4bfa-8da5-ee57cf5f9b10 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.497678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c66416-bc77-44eb-adc2-642647447b49 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.508921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.509655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.509895 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.510164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.510927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:42.511238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:42.512669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:42.522511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 187/363] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:42.523362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.529721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.546011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.546826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.547111 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.547388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.566139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:42.574856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:42.575953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:42.576957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 177/364] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:42.578323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.638616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29fe1c-f683-4448-af31-e81a46fcf88b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.663205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.675876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.676783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.677066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.677342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.678564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:42.680011 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:42.681765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 188/365] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:42.682681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.694580 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa74c16-8ec5-4515-b1a2-faf0a063e703 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.741439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.742260 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.742548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.742827 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.755798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:42.764556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:42.765577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:42.767023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 178/366] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:42.778489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:42.796819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1706-94d9-42ac-947e-cc413bbde665 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.833784 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.834753 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.835199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.835653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.845266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.896445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f790e-7163-4729-8e1c-0d7f34af625d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:42.905578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:42.918309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:42.920544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:42.940882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:42.941645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:42.942033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:42.942660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:42.944661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:42.945094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:42.947411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:42.966950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 179/367] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:42.966950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.052683 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 189/368] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:43.053911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.104984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a9f0a-654e-4f30-8e02-eff4490344c8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.106986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.152157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.153491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.153881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.154262 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.156219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.157847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.160502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 180/369] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:42 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.161701 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.163847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.198747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d726b7-ef1e-4c85-aa25-78f5763b4f1e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.252295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.253063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.253349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.253629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.254395 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:43.254705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.256085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.268687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 190/370] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.269570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.287946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5994-5c50-49b9-8b99-81e2102eda4f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.337746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.338427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.338720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.339009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.398835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.402039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ffc2c-7624-406b-81fd-61fb24cde2ec None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.422067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.423861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.444925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.445892 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.446571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.446868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.448320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.450375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.452693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 191/371] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.458204 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.489749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.560844 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 181/372] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:43.561711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.596021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611f1b4-0c79-41e3-8433-dd3ff8e3d4b3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.638670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.639330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.639611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.639883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.642998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=a4d5db833fd44ac889249234d40e4f0f) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:43.643328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.644809 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.650833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 192/373] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.651720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.655306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.702390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4b1-9007-4f22-bfc8-647a206c5aff None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.751765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.753220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.753508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.753790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] PATH_INFO: `/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.755487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] RBAC: Authorizing `identity:get_user(user_id=6dbf75eb97dc48dcb279ea066ae5a61c)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.757263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.760140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 182/374] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/users/6dbf75eb97dc48dcb279ea066ae5a61c => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.766433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.775764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:43.823283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76042e93-929f-4d36-a261-62dbff45db47 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.909218 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.910096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.910381 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.910499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed5cf6-db9a-4105-994e-8ef8701e6542 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:43.910670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.912312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.914776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.916773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 193/375] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.917578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.955298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:43.956233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:43.956574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:43.956853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] PATH_INFO: `/v3/projects/44a5902da22b4735a197547a87e04a33` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:43.958169 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] RBAC: Authorizing `identity:get_project(project_id=44a5902da22b4735a197547a87e04a33)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:43.959731 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:43.961909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 183/376] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/projects/44a5902da22b4735a197547a87e04a33 => generated 344 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:43.962708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:43.974796 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.064136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a26db-81c4-4910-9417-0515c0c41233 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.127844 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471d4bc-4b80-46b4-9568-b5f778eee976 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.135434 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.137223 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.137513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.137794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.138638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] RBAC: Adding query filter params (role.id=762fa3e8009e406db8b7ba64e54766b9, user.id=6dbf75eb97dc48dcb279ea066ae5a61c, scope.system=all) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:44.138953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:44.140448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:44.169557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 194/377] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/role_assignments?user.id=6dbf75eb97dc48dcb279ea066ae5a61c&scope.system=all&role.id=762fa3e8009e406db8b7ba64e54766b9 => generated 510 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:44.169557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.186536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.187627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.188197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.188742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.189851 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:44.190405 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:44.192247 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0f2f-b062-4a8f-b159-dacb210ad37d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:44.194345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.202581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 184/378] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:43 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:44.202581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902029-3238-4073-b792-a0b20252b18d None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.202581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902029-3238-4073-b792-a0b20252b18d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.202581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902029-3238-4073-b792-a0b20252b18d None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.202581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 185/379] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:44.213375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c336c-c422-4c76-a1ae-53ae069338ad None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.213557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c336c-c422-4c76-a1ae-53ae069338ad None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.213840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c336c-c422-4c76-a1ae-53ae069338ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.239824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ff2c336c-c422-4c76-a1ae-53ae069338ad None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:44.241082 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ff2c336c-c422-4c76-a1ae-53ae069338ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:44.350184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.359584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 186/380] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:44.370294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8cae-81cb-46ba-8fa4-f27ca03627f6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.370637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8cae-81cb-46ba-8fa4-f27ca03627f6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.370748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2a0d7-f3f1-400e-9594-80a1f00784b5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.370840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8cae-81cb-46ba-8fa4-f27ca03627f6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.376650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 187/381] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:44.380717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.381048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.381288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.416771 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:44.417015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.417886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.418012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:44.418212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.418448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] PATH_INFO: `/v3/groups/074e34c0d35a4a3882d06ee831f76300` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.425316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] RBAC: Authorizing `identity:get_group(group_id=074e34c0d35a4a3882d06ee831f76300)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:44.426950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:44.430012 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 195/382] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/groups/074e34c0d35a4a3882d06ee831f76300 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:44.430866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.536618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 188/383] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:44.537494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.558409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.593348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea5c80-123f-44fb-942e-b8b2b59fd6e2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.634303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.635111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.635399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.635681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.650401 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40569460-a00d-47db-aa31-ff24c57365e3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.650945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:44.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:44.660238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:44.661186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 196/384] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:44.661935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.680753 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.687666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141b85-92be-4385-b391-c727ef540720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.689506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b85-92be-4385-b391-c727ef540720 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.689696 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b85-92be-4385-b391-c727ef540720 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.689947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b85-92be-4385-b391-c727ef540720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.691139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141b85-92be-4385-b391-c727ef540720 None admin] RBAC: Adding query filter params (group.id=074e34c0d35a4a3882d06ee831f76300, role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=44a5902da22b4735a197547a87e04a33) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:44.691598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141b85-92be-4385-b391-c727ef540720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:44.693466 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141b85-92be-4385-b391-c727ef540720 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:44.701708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 189/385] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/role_assignments?group.id=074e34c0d35a4a3882d06ee831f76300&scope.project.id=44a5902da22b4735a197547a87e04a33&role.id=735ab5a0807540ac8694a65c7eac940b => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:44.704233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141b85-92be-4385-b391-c727ef540720 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.809823 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e44a3e-9f7b-48da-80ed-03498cc3a447 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.854772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141b85-92be-4385-b391-c727ef540720 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:44.855594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.856465 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.856758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.857039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.860628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:44.872939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:44.883958 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:44.885081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:44.885983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 197/386] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:44.898404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:44.937224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:44.937962 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:44.938781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:44.939058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:44.939818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:44.940126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:44.941546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:44.956903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 190/387] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:44.962061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.052922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:45.084687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17569a-ca6e-4f1f-882c-eacd50561dec None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.103671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d6086-0906-4826-afb0-86ec05476d6c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.144606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.145484 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.145774 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.146059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.147263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.148739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.150726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 191/388] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:45.156347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.181096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.181783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.182065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.182342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.183110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:45.183420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.184853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.199815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 198/389] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:45.205410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.264756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a07a5-619b-457d-94a3-435fbabc133d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.290630 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:45.306309 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.307654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.307654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.307836 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.310467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.312924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.323281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 192/390] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:45 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:45.324345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.339496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:45.405774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaccf3d-13fe-4f90-8a8b-f2bf8b2f1a1b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.443830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7aa8-f7e1-4769-9f6d-38e7b33284c3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.462103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.462978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.463263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.463540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.468914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.470940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.476511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 199/391] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:45 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:45.478685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.481538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.482616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.482940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.483294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/groups/2dc0f318e29a472985a38491c71b620d/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.485437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, group_id=2dc0f318e29a472985a38491c71b620d, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.487379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.557618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 193/392] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:04:45 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/groups/2dc0f318e29a472985a38491c71b620d/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:04:45.613777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a29e3-ac9a-46a0-b465-02f18c2c61d7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.649059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:45.659425 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.664291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.664291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.664291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.664291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.664291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f7f3f-02ce-4659-a7de-90accddeebe5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.666408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:45 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:45.673019 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:45.773186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:45.825761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1620-9010-4d75-87c1-b9eb7b8ee2de None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:45.866110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:45.866940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:45.867229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:45.867509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68/groups/2dc0f318e29a472985a38491c71b620d/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:45.869859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8e84c687f28426ea303c50b8d302a68, group_id=2dc0f318e29a472985a38491c71b620d, role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:45.871921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd7888-63e9-47e0-9487-35bda66b6b68 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:45.951676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 194/394] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:04:45 2022] PUT /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68/groups/2dc0f318e29a472985a38491c71b620d/roles/07aea8814ab24e5f92f880cad751bce9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:46.453310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a03e-a05b-4595-90d8-0b7530fcbc53 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:46.454392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a03e-a05b-4595-90d8-0b7530fcbc53 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:46.454510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349a03e-a05b-4595-90d8-0b7530fcbc53 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:46.456367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 201/395] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:46.461811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:46.462103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:46.462385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:46.488889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:46.490085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:46.573240 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 195/396] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:46.608333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a03e-a05b-4595-90d8-0b7530fcbc53 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:46.742460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349a03e-a05b-4595-90d8-0b7530fcbc53 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:46.780202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:46.781038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:46.781319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:46.781596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] PATH_INFO: `/v3/roles/member` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:46.793529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:46.801836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:46.803335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:46.804879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 202/397] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:46.809088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:46.866907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:46.935855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd16069-3d94-411f-b409-b3b2141fcf7f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:46.976863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:46.977458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:46.977744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:46.978113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:46.978867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:46.979176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:46.980587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:46.992026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 196/398] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:46.997372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:47.065400 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:47.110934 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ef511-dec7-4476-8614-5e494650f73e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:47.146769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:47.147694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.148074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.148362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.149631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:47.151081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:47.153095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 203/399] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:46 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:47.161544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:47.280437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ea4e9-15b9-4d5a-af77-4c64cd2a6dcf None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:47.283354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:47.323123 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:47.324048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.324337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.324645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.326272 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:47.327776 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502e188-e3a6-40b3-9384-f51ae1ea144d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:47.330379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 197/400] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:47 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:47.336052 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:47.447746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf4cd-3e91-4c03-8d21-c682ce77a6fb None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.452110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf4cd-3e91-4c03-8d21-c682ce77a6fb None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.452693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbf4cd-3e91-4c03-8d21-c682ce77a6fb None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.459239 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 198/401] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:47.461104 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.461623 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.462115 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.477375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dfd7a-23c8-4865-be83-f46e40cd234a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:47.482544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:47.484809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:47.509070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:47.525985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:47.526891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.527325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.527618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/groups/2dc0f318e29a472985a38491c71b620d/roles/7dc95c4d58004997b44d6ac89f699a19` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.530066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, group_id=2dc0f318e29a472985a38491c71b620d, role_id=7dc95c4d58004997b44d6ac89f699a19)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:47.535288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:47.605516 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 199/402] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:47.630438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:47.650821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 204/403] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:04:47 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/groups/2dc0f318e29a472985a38491c71b620d/roles/7dc95c4d58004997b44d6ac89f699a19 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:47.790590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04766ca6-c4e1-493d-aa03-e83977badcdc None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:47.798505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:47.835499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:47.836336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.836647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.836926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.851120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-24e8a5ed-2303-4d67-95d9-72e1aefadf10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:47.865124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:47.866188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:47.867083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 200/404] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:47.872930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:47.908501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231f17-39fa-47c6-b35c-a520585dc17b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.908840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231f17-39fa-47c6-b35c-a520585dc17b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.909239 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71231f17-39fa-47c6-b35c-a520585dc17b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.911281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 201/405] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:47.917661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:47.917992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:47.918227 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:47.947994 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:47.950439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:48.030321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980f35-e0f3-4d78-8cc8-c01937df1872 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.044839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 202/406] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:48.064910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.077068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.077755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.078041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.078318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.079485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:48.079803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.081657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.100793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 205/407] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.108070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.170510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.189139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7488f9-20c0-4926-a123-5c821c7ee70e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.204783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.226594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.227787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.228286 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.228830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.241176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd50b0-2e52-49a2-b3c0-e0586dd7c188 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.244845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-95a55c87-f3b1-4a52-972a-5a88b4aab585 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:48.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:48.252151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:48.253166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:48.255887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 203/408] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:48.257717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784375a-9c22-4e69-9a15-aefe9bf25539 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.258232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784375a-9c22-4e69-9a15-aefe9bf25539 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.258983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784375a-9c22-4e69-9a15-aefe9bf25539 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.261070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 204/409] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:48.261989 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784375a-9c22-4e69-9a15-aefe9bf25539 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.282247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.283517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.284008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.284567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.285992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.287715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9e534-e500-44f5-98b7-c16b9b3dda59 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.294107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 206/410] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.295685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634494-2667-4967-a150-e202c59f5f17 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.296192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634494-2667-4967-a150-e202c59f5f17 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.296724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634494-2667-4967-a150-e202c59f5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.314922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-15634494-2667-4967-a150-e202c59f5f17 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:48.316504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-15634494-2667-4967-a150-e202c59f5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:48.373925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784375a-9c22-4e69-9a15-aefe9bf25539 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.386574 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 207/411] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:48.387782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634494-2667-4967-a150-e202c59f5f17 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.434153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.434852 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.435141 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.435425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.436532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:48.436853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.438456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.449940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.450801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.456966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.472775 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.500590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634494-2667-4967-a150-e202c59f5f17 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.538777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.539930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.540483 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.540957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.542412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.544069 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.546215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 208/413] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.547245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.583816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e1d86-22a9-4a73-bd86-436ea20c1744 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.622925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.624097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.624418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.624703 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.639061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:48.648505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:48.649545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:48.650459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:48.655048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 206/414] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:48.656321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.680072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a0c46-eb9f-49eb-b58a-4645117dca61 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.694246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.732071 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.733020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.733256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.733537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] PATH_INFO: `/v3/groups/074e34c0d35a4a3882d06ee831f76300` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.734795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] RBAC: Authorizing `identity:get_group(group_id=074e34c0d35a4a3882d06ee831f76300)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.737062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.738836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/groups/074e34c0d35a4a3882d06ee831f76300 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.739666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.762855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:48.790546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93d954-ba2c-4454-bb7b-add9480e6bd7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.824632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.825514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.825803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.826098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f/groups/2dc0f318e29a472985a38491c71b620d/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.829147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d5db833fd44ac889249234d40e4f0f, group_id=2dc0f318e29a472985a38491c71b620d, role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.830614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afe425-623d-4e71-9e0a-9650a84c40e9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.846108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdf262-74d9-40ad-add2-eb7cc9168c38 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:48.878365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:48.879032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.879320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.879640 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.880350 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] RBAC: Adding query filter params (name=member) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:48.880692 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:48.883942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:48.890196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 210/416] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:48.891486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 207/417] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:04:48 2022] PUT /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f/groups/2dc0f318e29a472985a38491c71b620d/roles/07aea8814ab24e5f92f880cad751bce9 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30626-d64a-4ba0-ba8c-dc180507998c None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30626-d64a-4ba0-ba8c-dc180507998c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee30626-d64a-4ba0-ba8c-dc180507998c None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 208/418] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:48.912439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee30626-d64a-4ba0-ba8c-dc180507998c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:48.949474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.059164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbe9a1-b88b-49a4-8e56-db0f9ed1b28a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.075145 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee30626-d64a-4ba0-ba8c-dc180507998c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.113002 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.114023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.114529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.115019 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.120068 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.123135 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.124022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.124307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.124611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] PATH_INFO: `/v3/projects/44a5902da22b4735a197547a87e04a33` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.129510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] RBAC: Authorizing `identity:get_project(project_id=44a5902da22b4735a197547a87e04a33)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:49.134627 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dfb31-5854-499e-9924-3f29344dbd8a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:49.136788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 211/419] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/projects/44a5902da22b4735a197547a87e04a33 => generated 344 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:49.138156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.138442 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.138724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.177538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:49.178962 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:49.259017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:49.261959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:49.270988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 212/420] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:49.272930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.355636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.399956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 209/421] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:49.400852 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.438320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.440998 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1537d-9512-4d2b-ab5e-185eb2f6623c None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.507906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.509114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.509400 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.509676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] PATH_INFO: `/v3/projects/44a5902da22b4735a197547a87e04a33/groups/074e34c0d35a4a3882d06ee831f76300/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.512392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] RBAC: Authorizing `identity:create_grant(project_id=44a5902da22b4735a197547a87e04a33, group_id=074e34c0d35a4a3882d06ee831f76300, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:49.514382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:49.516891 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277242c1-6f69-4d1f-99ea-f2686e991b14 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.555539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.556374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.560422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.560422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.569397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:49.578766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:49.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 210/422] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:49.592133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.639033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 213/423] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:04:49 2022] PUT /identity/v3/projects/44a5902da22b4735a197547a87e04a33/groups/074e34c0d35a4a3882d06ee831f76300/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:04:49.645490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.732510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.743606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f83b38-945d-4db4-9cf7-4442866967e3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.817593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.818480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.818769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.819052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.820528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:49.822009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:49.823772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 211/424] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:49 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:49.830839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.849774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:49.855258 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663a7c-944b-49a2-8a93-10a797291089 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:49.894889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:49.895498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:49.895791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:49.896133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:49.896966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:49.897286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:49.898678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:49.909160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:49.917935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:49.964262 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07f72-ccbe-4465-a6cf-fa0947efb933 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.001275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.001939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.002229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.002513 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.003712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.005252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.007228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 212/426] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:49 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.017439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.029936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01634bc4-d25c-42f6-81c3-18f40ae82d3f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.066011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.069885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.071770 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.072287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.072835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.109260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.161516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.162046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0d676-0c8a-4bc1-8b0f-355f7bed2b49 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.162997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.204289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.205023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.205302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.205582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.206469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=f8e84c687f28426ea303c50b8d302a68) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:50.206782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.208268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4753b8bf-7c95-4cb7-a331-109c8da59b1c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.215505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 213/427] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.217061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a03f8-bf8c-4d63-a83b-65a42d171836 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.217354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a03f8-bf8c-4d63-a83b-65a42d171836 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.217635 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a03f8-bf8c-4d63-a83b-65a42d171836 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.219514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 214/428] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:50.238753 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.239190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.239574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.272731 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:50.273982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:50.299150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 215/429] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:50.305691 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.379746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.427171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:50.438903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2c8d1-2542-4eec-b355-707c2c0778b0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.454212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.476234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.477132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.477412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.477697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] PATH_INFO: `/v3/projects/f8e84c687f28426ea303c50b8d302a68` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.478888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] RBAC: Authorizing `identity:get_project(project_id=f8e84c687f28426ea303c50b8d302a68)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.480349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.483673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 216/431] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/projects/f8e84c687f28426ea303c50b8d302a68 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.483784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.493348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.582591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115b24-fcaa-4398-b976-e764fed1c3a6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.604728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1a7f5-9515-4db9-addc-723d6ea37c89 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.624697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.626523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.627037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.627550 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.632593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.641756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.642214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:50.642621 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.645458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.645458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.645458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.645957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.647939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 217/432] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:50.655566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:50.656664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:04:50.657562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:50.659189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.660287 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 216/433] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:50.668873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.778088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57af0d-697a-4731-8036-1ddcdd86b4ac None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.798817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.818128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d802e9-224b-4c0a-badf-d441721a1cb0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:50.821537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.822234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.822537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.822811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.823661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=f8e84c687f28426ea303c50b8d302a68) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:50.823977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.825448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.840622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=f8e84c687f28426ea303c50b8d302a68&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.864204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:50.865093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:50.865478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:50.865858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:50.866790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] RBAC: Adding query filter params (name=member) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:50.867274 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:50.868893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd1b1d-12d4-4c08-8efd-53287e879393 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:50.879775 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 217/435] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:50.885968 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:50.953169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:50.999257 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed7e67-1d0c-4bfe-b5f8-1fd5560a6055 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.035630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.036285 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.036597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.036878 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.106871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.108350 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:51.171529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.216777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 219/436] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:51.221634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e5d1-5b6a-496f-ac1f-b03c43f021b6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.222090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e5d1-5b6a-496f-ac1f-b03c43f021b6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.222361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.222492 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8e5d1-5b6a-496f-ac1f-b03c43f021b6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.224211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 218/437] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:51.229689 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.230116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.230493 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.248735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:51.250077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:51.339008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 219/438] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:51.356373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bdf09-1d95-4f41-a3ff-c7e1744b9d97 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.364512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.396646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.397524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.397812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.398078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.399279 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.400822 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:51.402713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 220/439] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:51.408901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.438550 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.455061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.477805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d6690-1b4c-4301-9ce7-02e207694c55 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.513339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bcbb6-7beb-4bce-9fee-84b74d96e62d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.513828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.514643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.514924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.515203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.525535 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:51.534948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:51.536166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 220/440] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:51.541790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.556844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.557799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.558093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.558377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.559581 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.561172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:51.562841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 221/441] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:51.568777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.664348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33257345-b48f-4d1f-a92c-db938265c3ba None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.673531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.679585 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6457e8a-ca39-45f1-a918-c450360028f2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.701402 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767438d2-236f-425e-b225-4e549b44675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.702404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767438d2-236f-425e-b225-4e549b44675d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.702767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767438d2-236f-425e-b225-4e549b44675d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.703052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767438d2-236f-425e-b225-4e549b44675d None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.707165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767438d2-236f-425e-b225-4e549b44675d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:51.707165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767438d2-236f-425e-b225-4e549b44675d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.707165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767438d2-236f-425e-b225-4e549b44675d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:51.711649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.716570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 221/442] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:51.721966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767438d2-236f-425e-b225-4e549b44675d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:51.726694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.726694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.726694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.726694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.727049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=7dc95c4d58004997b44d6ac89f699a19, scope.project.id=a4d5db833fd44ac889249234d40e4f0f) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:51.727049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.727945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:51.734333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=7dc95c4d58004997b44d6ac89f699a19 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:51.835881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767438d2-236f-425e-b225-4e549b44675d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:51.872658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:51.873331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:51.873622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:51.873908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:51.945015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:51.948980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:51.950457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4eeb3-5381-482d-ab38-4c090d651733 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.058369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 222/444] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:04:52.065338 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.110224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961679c-1032-4b81-8978-acf80f395597 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.110427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961679c-1032-4b81-8978-acf80f395597 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.110715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961679c-1032-4b81-8978-acf80f395597 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.112087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 223/445] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:04:52.117090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.117378 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.117657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.134842 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:52.136012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:52.171163 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7e1c-9514-4f44-824e-fe95c52dee14 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.202482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 224/446] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:52.204679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.205547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.205836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.206119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] PATH_INFO: `/v3/projects/a4d5db833fd44ac889249234d40e4f0f` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.207315 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d5db833fd44ac889249234d40e4f0f)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.208789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.210601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 223/447] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/projects/a4d5db833fd44ac889249234d40e4f0f => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:52.215857 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.226728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.244237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:52.254852 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:52.315296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10cbb-9468-45be-80b2-44db215a0895 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.325202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07e85-b9ac-48d0-8a56-adba4b1104d8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.349254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.350105 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.350385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.350653 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] PATH_INFO: `/v3/groups/2dc0f318e29a472985a38491c71b620d` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.351843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] RBAC: Authorizing `identity:get_group(group_id=2dc0f318e29a472985a38491c71b620d)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.353300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.354906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 225/448] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/groups/2dc0f318e29a472985a38491c71b620d => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:52.358245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.359031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.359315 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.360143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.361161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.370356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:52.378091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:52.379305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:52.380996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 224/449] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:52.385065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.453413 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:52.459091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5583f-3d33-4b97-9c02-05518ec88c82 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.471782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:52.483978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789a330-78af-4230-b7e8-517f6a1e6c91 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.492965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.493621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.493900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.494179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.495006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] RBAC: Adding query filter params (group.id=2dc0f318e29a472985a38491c71b620d, role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=a4d5db833fd44ac889249234d40e4f0f) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:52.495323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.496810 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.502628 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 226/450] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/role_assignments?group.id=2dc0f318e29a472985a38491c71b620d&scope.project.id=a4d5db833fd44ac889249234d40e4f0f&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:52.518583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.519274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.519591 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.519866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.520676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:52.520988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.522416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.532638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 225/451] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:52.538076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.643536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7701cbb-0015-4564-bd87-126757c2c0ca None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.679434 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.680089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.680375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.680689 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.709636 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:52.751973 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.753475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.852306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 227/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:04:52.858196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:52.956801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6043e6b-e8de-4d04-b654-c7e9552663e2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:52.989069 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:52.989927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:52.990214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:52.990497 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] PATH_INFO: `/v3/projects/44a5902da22b4735a197547a87e04a33` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:52.991682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] RBAC: Authorizing `identity:get_project(project_id=44a5902da22b4735a197547a87e04a33)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:52.993179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:52.994859 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 226/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/projects/44a5902da22b4735a197547a87e04a33 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:53.000788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:53.057209 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:53.097356 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9307a1-31cd-419d-858f-43c621c396c3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:53.129679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:53.130519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:53.130798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:53.131070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] PATH_INFO: `/v3/groups/074e34c0d35a4a3882d06ee831f76300` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:53.132205 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] RBAC: Authorizing `identity:get_group(group_id=074e34c0d35a4a3882d06ee831f76300)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:53.133926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d9cad-02cc-4a0b-99f1-7c32d1e152aa None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:53.135513 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 228/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:04:52 2022] GET /identity/v3/groups/074e34c0d35a4a3882d06ee831f76300 => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:53.141847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:53.160341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:53.237746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6b17-275e-48b6-be05-694630ab3f90 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:53.270200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:53.270835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:53.271115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:53.271394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:53.272212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] RBAC: Adding query filter params (group.id=074e34c0d35a4a3882d06ee831f76300, role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=44a5902da22b4735a197547a87e04a33) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:53.272552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:53.273965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f11af-0ad8-44ab-aeb7-1f8c0919e347 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:53.279575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 227/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:04:53 2022] GET /identity/v3/role_assignments?group.id=074e34c0d35a4a3882d06ee831f76300&scope.project.id=44a5902da22b4735a197547a87e04a33&role.id=735ab5a0807540ac8694a65c7eac940b => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:55.832513 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b8867-c710-47da-9f8b-1bea30126362 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:55.833576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b8867-c710-47da-9f8b-1bea30126362 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:55.834079 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b8867-c710-47da-9f8b-1bea30126362 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:55.835942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 229/456] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:55.840906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdc08-48e5-42b5-946f-d8e546adf605 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:55.841721 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdc08-48e5-42b5-946f-d8e546adf605 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:55.842212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecdc08-48e5-42b5-946f-d8e546adf605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:55.866751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-86ecdc08-48e5-42b5-946f-d8e546adf605 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:55.868328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-86ecdc08-48e5-42b5-946f-d8e546adf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:55.958081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 228/457] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:55.995279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b8867-c710-47da-9f8b-1bea30126362 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.053441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25936-4a9e-4349-97e0-d2d789cedd7b None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.054144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25936-4a9e-4349-97e0-d2d789cedd7b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.054668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a25936-4a9e-4349-97e0-d2d789cedd7b None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.056377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 229/458] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:56.061398 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08fac7-b406-4feb-96e4-3f86062921fc None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.062038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08fac7-b406-4feb-96e4-3f86062921fc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.063072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08fac7-b406-4feb-96e4-3f86062921fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.090734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-ba08fac7-b406-4feb-96e4-3f86062921fc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:56.094035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-ba08fac7-b406-4feb-96e4-3f86062921fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:56.112440 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.161131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b8867-c710-47da-9f8b-1bea30126362 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.188875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.209102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.210290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.210834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.211333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.224803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.226662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.228113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:56.229790 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f62c-51f5-4705-be53-1ea1c43f6aed None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.230078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f62c-51f5-4705-be53-1ea1c43f6aed None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.230515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80f62c-51f5-4705-be53-1ea1c43f6aed None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.236617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 231/460] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:56.237968 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.238485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.238974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:04:56.259514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:56.260614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:56.261578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:04:56.261578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:04:56.261578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.261578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:56.262397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 230/461] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:56.263194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.269416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:56.270882 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:56.348520 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 232/462] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:56.349524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.396494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d712f-0dc4-4ae0-9aac-f8e6e93e9690 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.434984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.435659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.436008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.436464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.447951 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.449572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.453804 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:04:56.468373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:56.469959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:56.470916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:04:56.470916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:04:56.470916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.470916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:56.470916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 231/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:56.471222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.491810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ee1d8-454b-4a98-a6a6-cdc8873b9829 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.512606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.530260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.530977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.531919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.532206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.532984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:56.533325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.534709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.559133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 233/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:56.559133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.596091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af92d0-41c0-454e-82fb-4bd36909426b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.634678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.635657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.635786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.636023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.647263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.648754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.661535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17d292-5c67-4712-a142-05ccdae8c98c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-8d6e2fab-f8f1-4640-be05-f8263a94fc55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:04:56.667150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:56.668130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:56.669158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:04:56.669158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:04:56.669158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:56.669158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:56.672764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 232/465] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:56.674944 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674f33-3ba3-4918-8fd5-ed381d5d0dbd None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.675491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674f33-3ba3-4918-8fd5-ed381d5d0dbd None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.675754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674f33-3ba3-4918-8fd5-ed381d5d0dbd None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.677276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 233/466] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:56.677821 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674f33-3ba3-4918-8fd5-ed381d5d0dbd None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.698677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.714035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.714035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.714035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.714035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.714451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:56.714451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.714451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.728625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 234/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:56.729524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.779605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:56.796673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674f33-3ba3-4918-8fd5-ed381d5d0dbd None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.833713 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.834406 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.834654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.834930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.835625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.837089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.844981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b214d-e029-4bff-a999-a48d1737c97e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:56.880954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:56.881651 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.881940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.882358 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.883091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:56.883405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:56.885090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a8eb5-bc6c-40e4-be74-ed723a66cd2a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:56.896878 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 235/468] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:56.898090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:56.898392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:56.898672 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:56.916020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:56.917244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:56.945359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 234/469] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:56 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:56.946496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:56.985166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.020430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 236/470] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:57.020430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.075166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e693674-1299-4301-b068-ef30b5277a34 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.112498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.113146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.113428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.113704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.114410 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.116659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73041fb-3e77-4f5b-8f19-0efebd02433e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.127083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.131908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b5a36-75d2-4dec-8102-cf25c268ed06 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.168687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.169360 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.169642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.169914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.170623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.172607 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eecd74-25a3-489d-be9d-af01c09f769b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.195972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 235/471] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:56 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:57.197458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e73e1-d8bd-414a-a8f8-c2af913e2506 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.197753 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e73e1-d8bd-414a-a8f8-c2af913e2506 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.198030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e73e1-d8bd-414a-a8f8-c2af913e2506 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.199411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 236/472] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:57.204463 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e73e1-d8bd-414a-a8f8-c2af913e2506 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.301713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 237/473] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:57 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:04:57.304083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125339-a503-4e57-919f-052c6837800d None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.304376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125339-a503-4e57-919f-052c6837800d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.304684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9125339-a503-4e57-919f-052c6837800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.340382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c9125339-a503-4e57-919f-052c6837800d None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:57.341575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c9125339-a503-4e57-919f-052c6837800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:57.347488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e73e1-d8bd-414a-a8f8-c2af913e2506 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.397987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.399031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.400801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.401326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.401817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.418257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.420937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:04:57.445292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:57.448270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:57.449476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:04:57.449476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:04:57.449476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:04:57.449476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:04:57.449476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 237/474] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:57.452593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.454449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 238/475] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:04:57.479913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125339-a503-4e57-919f-052c6837800d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.532075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.589391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16481c2-d451-4b90-b7c6-78febc37425d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.625127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9125339-a503-4e57-919f-052c6837800d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.626972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.627720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.628081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.629074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.629190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:57.629580 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.631034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.645355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 238/476] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:04:57.650825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.665547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.666495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.666977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.668268 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.669695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.671511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.714514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.sql.core [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:04:57.714514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 23:04:57.714514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [parameters: {'id': 'f40e0181bda347cb8eb18fe1ff54401e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 23:04:57.714514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=221126) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application result.read() Jun 29 23:04:57.750449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:04:57.751478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application yield resource Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise self.value Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application session.commit() Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:04:57.752562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:04:57.753513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:04:57.754484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application result.read() Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:04:57.755399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [parameters: {'id': 'f40e0181bda347cb8eb18fe1ff54401e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:57.756266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 23:04:57.766263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:57.770025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e673bad-6760-4af1-b763-8d76eecafec7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.771527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 239/477] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:04:57 2022] POST /identity/v3/roles => generated 144 bytes in 291 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:57.776665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.777147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:57.804757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.805581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.805868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.806146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.806922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:57.808379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:57.847099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:57.890122 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 239/478] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:04:57 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:04:57.937872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c6b51-3ca9-454a-a441-1016068e2c9a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:57.984600 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:57.985437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:57.985720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:57.986089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:57.999732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-daed7109-34fa-433c-afc9-70b672585885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:58.008472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:58.011134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:58.013331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 240/479] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:04:58.017005 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:58.153449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1491de-bae0-4a16-b146-3679d6206bfb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:58.192518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:58.193204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:58.193490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:58.193766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:58.194525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:58.194838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:58.196218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1662d5-ca3d-4ff3-ab7f-148bb76fef06 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:58.206221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 240/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:04:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:59.302033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fef27-0386-450a-8470-0e658a6ae0fc None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.302603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fef27-0386-450a-8470-0e658a6ae0fc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.302603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3fef27-0386-450a-8470-0e658a6ae0fc None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.304202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 241/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:59.309711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.310127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.310327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.327805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:59.329578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:59.360093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:59.414023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:04:59.439081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fef27-0386-450a-8470-0e658a6ae0fc None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:59.564153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:59.577166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3fef27-0386-450a-8470-0e658a6ae0fc None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:59.629125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:59.629944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.630227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.630501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.645279 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-30fca03a-d243-47c0-8a2d-9c63724dda60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:04:59.653128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:04:59.654123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:04:59.655047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:04:59.658898 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 242/483] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:04:59.660212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:59.814322 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abaac-d7e8-4d9f-bce2-981ffca729df None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.814967 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abaac-d7e8-4d9f-bce2-981ffca729df None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.815462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920abaac-d7e8-4d9f-bce2-981ffca729df None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.817343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 243/484] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:04:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:04:59.822387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.822907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.823421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.826708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdabc43-9c96-4cb6-943e-bb7a6c46a0fc None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:04:59.842006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:04:59.843579 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:04:59.870110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:04:59.871104 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:04:59.871394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:04:59.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:04:59.872480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:04:59.872801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:04:59.875397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:04:59.892437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 242/485] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:04:59.892928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:04:59.918287 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:04:59.969257 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 244/486] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:05:00.001394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.028584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138adaad-54bc-49ad-8fe8-3a7f190a9a26 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.071772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.072672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.072880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.073154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.083703 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.085182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-ac528d97-ce76-45ba-ab0c-e7f02570a0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:00.104067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:00.105132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:00.106071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:00.106071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:00.106071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:00.106071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:00.110420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 243/487] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:00.111723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c698-2c8c-4e0c-a98c-ec5dbad9209a None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.112006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c698-2c8c-4e0c-a98c-ec5dbad9209a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.112281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c698-2c8c-4e0c-a98c-ec5dbad9209a None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.117775 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 244/488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:00.118561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c698-2c8c-4e0c-a98c-ec5dbad9209a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.134286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.154986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eb71b-6b48-4a98-808b-51ec0ee348d5 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.191559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.194835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.195906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.196434 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.196973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.208294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-5375e6e0-874a-4ef7-acec-c1de0fb794ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:00.216715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:00.217700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:00.218623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:00.221446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 245/489] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:00.222981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.223629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.224207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.225086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c698-2c8c-4e0c-a98c-ec5dbad9209a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.244590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:00.246174 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:00.261611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.262274 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.262555 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.262834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.263556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:00.263862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.265629 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.282354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 245/490] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:00.283047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.326913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 246/491] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:00.328593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.405485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.412575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed5ab-85bc-4836-99c6-fd39dc6a4cc2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.441444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82eca02-e4f7-4222-9cc3-ac5190356bf0 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.445425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.451025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.452015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.452015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.458661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.458661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:00.458661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.458661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.463032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 246/492] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:00.463959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.483834 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.485702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.486238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.486737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] PATH_INFO: `/v3/users/nova` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.496015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.498018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:00.515949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:00.522631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 247/493] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:00.523679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.574326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59664-4046-48d1-aad1-32b3116afd87 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.610521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.611231 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.611512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.611789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.623930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:00.631559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:00.632805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:00.634095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:00.637922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 247/494] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:00.638819 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.640469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1e7e3-7a6f-4090-98e9-455fa95442fa None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.673210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.678095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.678904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.679189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.679501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.690024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.691502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.695405 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-00fade45-2dbd-4be1-8b6a-9c9e6d4d7a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:00.709526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:00.710513 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:00.711511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:00.711511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:00.711511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:00.711511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:00.711511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 248/495] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:00.712532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c19-c82e-471f-bb32-b833beca87ec None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.712532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c19-c82e-471f-bb32-b833beca87ec None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.712725 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8405c19-c82e-471f-bb32-b833beca87ec None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.719074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 249/496] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:00.719996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405c19-c82e-471f-bb32-b833beca87ec None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.759027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338ae0-8760-43e8-8e3c-60392e329f34 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.794474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.795248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.795425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.795704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.796595 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:00.796908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.798335 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.829356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8405c19-c82e-471f-bb32-b833beca87ec None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.839940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 248/497] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:00.839940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.866995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.867675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.867967 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.868250 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.869054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:00.869367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.870769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2829-7495-4bdc-8278-77eab9b29802 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.878983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 250/498] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:00.878983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.878983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.878983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.904172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:00.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:00.946015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c526a4-db00-41b8-8fcb-3f02cedb7cbb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:00.950736 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.957125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:00.988426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 251/499] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:00.988426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:00.988734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:00.988734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:00.988734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:00.988734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:00.989076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:00.989076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:00.989076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:00.995876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 249/500] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:00.995876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.090416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ea954-60ae-4389-a096-5b53f2483825 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.109317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8749f39-89ec-4b12-932f-394cd29b53d7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.124129 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.125254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.125531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.125801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.143908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.144730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.145021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.145301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.155808 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.157350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.170420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-acd4a4c5-28ce-44eb-8daa-96d548529a1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:01.175163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.176161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 250/501] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ed38-783e-4126-8ed1-cc82d1edec05 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ed38-783e-4126-8ed1-cc82d1edec05 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ed38-783e-4126-8ed1-cc82d1edec05 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.188073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 251/502] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:01.188723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703ed38-783e-4126-8ed1-cc82d1edec05 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.198057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.199614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.208508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.283123 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703ed38-783e-4126-8ed1-cc82d1edec05 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.295624 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 252/503] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:01.296476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.320608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.321407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.321699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.321978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] PATH_INFO: `/v3/users/glance` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.329627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.331074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:01.346738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.347815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 252/504] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.348971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.370874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.394938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b10c77-0ecf-40ab-8573-bbb94e320f9a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.428717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.429529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.429956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.429956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.430144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.440601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:01.447600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45631f5-97f3-4f84-8250-52cc798a6abd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-814d1f2d-9a4b-4607-a3d9-bb993c1c1553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:01.448375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.449404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:01.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:01.451102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 253/505] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.451951 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.452244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.452551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.469639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:01.470820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:01.486124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.486789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.487076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.487358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.488084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:01.488422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.489808 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.503311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 253/506] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:01.503959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.542436 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 254/507] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:01.543290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.606612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f09aa3-e1b6-412a-96f7-1ca7b1909f2f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.614629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.641073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.641853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.642140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.642411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.649154 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b10da-594c-430c-9632-67115f8dbbe6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.652745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.654171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.655894 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:01.671420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.672942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.673937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:01.673937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:01.673937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.673937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:01.673937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 254/508] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.674420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.686199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.686859 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.687746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.688046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.688926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:01.689241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.690682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.727230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 255/509] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:01.728113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.775468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592ae6-df61-45d3-9395-a5e4c638d7c5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.808734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.809406 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.809692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.809970 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.810716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:01.811030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.813060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.820954 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 255/510] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:01.822066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.831258 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813516be-45b0-4404-808b-67bcff03bb40 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.854595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.865789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.867922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.867922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.867922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.874760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.876187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.877694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:01.891666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.897491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 256/511] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.898516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:01.921468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b338-52a7-4508-a930-1e667902866f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:01.954712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:01.955505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:01.955789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:01.956073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:01.966764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:01.968233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:01.986559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:01.987686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 256/512] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:01.988865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.000016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1404857-fea5-4712-bf04-de4978efdf93 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.034527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.035182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.035468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.035748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.036531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:02.036843 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.038223 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.049835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 257/513] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:02.050616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.094632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cc8c8-a725-4834-b1f4-13473416f72f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.098835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.103403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.129030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.129686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.129978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.130260 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.152871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdd753-d732-43f3-b2ec-8c345eeec61f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.186921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.187668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.187955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.188235 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.197961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.198538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.199417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.199993 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:02.216974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:02.218178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:02.219841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:02.219841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:02.219841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:02.219841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:02.219841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 258/514] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:02.220210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.300299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 257/515] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:02.301376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.312024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.316276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.321741 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319a47-2ae7-4a3f-af0f-7c5ed9e9bffc None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.355473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.356147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.356457 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.356742 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.357608 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:02.357925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.359373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.377313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 259/516] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:02.378173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.399073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad15f7-7b8f-488a-9b6b-e9a0d3cdc457 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.432886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.433553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.433841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.434119 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.434836 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:02.435146 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.436539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.447879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 258/517] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:02.448440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.478097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59969e-7fc4-4e8e-8a18-c08e4ec6f8c0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.511987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.512802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.513128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.516614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.518207 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.520891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.522386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:02.537554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:02.538737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:02.539713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 260/518] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:02.540274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.552257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b03a4-e882-4593-b0db-5d87c936972c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.558439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.586788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.587452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.587738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.588040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.588767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:02.589088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.590451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.602594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 259/519] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:02.603388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.642994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9a940-d5d5-444c-8ed4-957768a8b8bd None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.676310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.677124 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.677409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.677685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.688057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.689544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.701672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b09fa2-7c61-4b49-9b38-fe2d1b01208f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:02.707623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:02.713406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 261/520] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:02.715148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.732861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.740658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.741315 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.741600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.741882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.779343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.811048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.813074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.813792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56a1c1-8b46-4dbf-bd3d-57b6916b17f5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:02.847559 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:02.848225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:02.848545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:02.848832 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:02.849540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:02.850991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:02.908760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 260/521] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:02.909665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:02.935141 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:02.956198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 262/522] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:05:02 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:02.956994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.018100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31239cba-a36c-4aa2-ab34-817a1cb0c935 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.063847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.064659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.064945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.065222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.066332 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.066332 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.067803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.079568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e05f6-e596-4e71-a515-52718ce9146c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.087279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 261/523] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.088423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.111333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.126866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.127675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.127961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.128239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.138278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.140127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:03.159371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:03.160552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:03.161646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 263/524] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:03.162326 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.194858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.207080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8976a-1a56-4d60-b1c0-c81bc55bbe91 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.242396 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.243095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.243379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.243657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.244392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.244738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.246114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.263044 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 262/525] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.263044 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.278899 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21276698-956a-414f-88f7-f1c37c85c30c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.316782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.317839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.318111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.318395 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.329508 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.331013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:03.348471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:03.349510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 264/526] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:03.350474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.377451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fc1c0-c9cc-497d-a7b3-0c8502126fe8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.386718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.416718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.417408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.417739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.417970 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.418960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.419277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.421231 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.432569 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 263/527] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.433479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.450913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.475225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469ba0a-9565-41ec-ae4a-196e2040621b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.523867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.524904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.525343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.525775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.527531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.528064 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.530345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.556433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 265/528] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.557460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.570376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1dcf59-166a-492b-95e7-a72c32ccf0d6 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.608491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.609917 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.610200 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.610477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.619012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.620477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:03.636006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:03.637070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:03.638063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 264/529] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:03.638617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.673854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.685491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05498672-2e46-4eba-b5ad-2284b21e3224 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.729785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.729970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.730962 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.731317 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.731663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.732653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.733405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.735669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.751044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 266/530] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.751965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.755656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968da7a6-79b6-4a1a-911f-e4985fea13b1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.807431 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.808176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.808947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.809230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.873215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72a909-320f-46db-bbac-c14db139fa36 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:03.898358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.899959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.916719 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:03.917673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:03.917957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:03.918232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:03.919184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:03.919499 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:03.921285 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:03.948566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 267/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:03.949440 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:03.969862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:03.979339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:04.022761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 265/532] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:04.023936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.074205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f24c3-ae55-4e35-ad6e-7a50f758aefd None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.113222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.114046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.114333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.114610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.122903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.124388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:04.141236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:04.143373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:04.145735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:04.152702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 268/533] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:04.152702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.157690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d84b1-41e4-4bf6-815e-625dbdb36fe4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.206294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.207454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.207744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.208028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.209196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=b7d1dca553bc493daf803986df6abac0) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:04.209543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.211775 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.224614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 266/534] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/role_assignments?user.id=b7d1dca553bc493daf803986df6abac0&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:04.226536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.246694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:04.284383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a28cdc-a33c-4dfc-a02f-94ff2ac22bfb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.310710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:04.328189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.329977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.330646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.331088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.345340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.347570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:04.381705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:04.382949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:04.384423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:04.384423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:04.384423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:04.384423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:04.394102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 269/535] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:04.399380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ade1c3-08ff-473a-9b08-233dbcb23227 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.400279 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.443293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.443965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.444250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.444557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.445355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:04.445669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.450716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.473944 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 267/536] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:04.479627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.586207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a47dd4-4f74-4806-8c1b-c53c31572a00 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.614574 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:04.618831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:04.630867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2bd0f-b0d7-4f07-b4f7-71d926ffaebf None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.637918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.638622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.638910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.639190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.639951 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:04.640827 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.642277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.667049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 270/537] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:04.677446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:04.683436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.684325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.684821 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.685257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.686252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=6b419d0f016a46468640dcc675629c4c) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:04.686729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.688448 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.695605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 268/538] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/role_assignments?user.id=6b419d0f016a46468640dcc675629c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:04.805398 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec27a60-b8ce-4ae2-9978-182a0922ca9d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:04.848232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:04.849017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:04.849305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:04.849584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:04.857777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:04.859409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:04.879468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:04.880722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:04.882009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:04.885339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 271/539] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:04.891487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.035217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3684c8c-b42b-4eda-9413-fd0de01baa5d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:05.086493 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:05.087167 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.087453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.087798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.088625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:05.088938 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:05.090397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810568cd-9601-4da7-a683-7558604b59a5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:05.108004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 269/540] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:05.113955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.190649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:05.244276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec674e-d1ec-4464-901c-1d455994216d None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.244982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec674e-d1ec-4464-901c-1d455994216d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.245483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec674e-d1ec-4464-901c-1d455994216d None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.247380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 270/541] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:05.254327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.254618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.254900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.272643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:05.273335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9cab8-71ea-4ffb-aa50-36840085730f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:05.274436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:05.292784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:05.326106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:05.326776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.327060 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.327335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.328285 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=9b0efc8226b943e583cc04914602f2a2) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:05.328631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:05.330142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:05.336739 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 272/542] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/role_assignments?user.id=9b0efc8226b943e583cc04914602f2a2&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:05.352572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 271/543] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:05.379210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.529020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f01ce-bb94-47f6-a079-d8de45fe7624 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:05.543613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:05.571595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:05.572432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.572716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.573000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.589542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-6d206219-a6bf-4008-9054-4051e07fe3aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:05.598040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:05.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:05.600094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 273/544] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:05.607511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.715249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cdb08-24ca-47be-a809-6065deecc6c6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:05.746234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aedfc-ede3-4054-a15f-dd17ef4ff7e0 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.746580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aedfc-ede3-4054-a15f-dd17ef4ff7e0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.746911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aedfc-ede3-4054-a15f-dd17ef4ff7e0 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.748295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 274/545] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:05.751853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:05.752567 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.752860 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.753149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.753469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.753760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.753953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:05.754055 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.754224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:05.755691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:05.764978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 272/546] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:05.770511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.789154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:05.797926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:05.799164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:05.881591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8daa3a-0374-4f2c-9bf6-3a88509a8f0b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:05.919829 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:05.920670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:05.921008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:05.921347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:05.927040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 275/547] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:05:05.932772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:05.934229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:05.953039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:05.954058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:05.956190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:05.956190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:05.956190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:05.956190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:05.956190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 273/548] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:05.960271 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:05.962140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.045708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:06.084607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e7ed2-e9a3-451f-a723-2f7cd2956ad4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.121496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.122311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.122600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.122883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.134202 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:06.143040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:06.144050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:06.145420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 274/549] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:06.152192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.203744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:06.210129 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e3baf-8439-49a3-8462-29259e749a84 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.274180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.274769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.275112 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.275396 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.276837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:06.277380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:06.278777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:06.300107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 276/550] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:06.310090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.359726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97a6a7-7965-46d9-86e1-a4f70b87d81a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.406687 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:06.427941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.428646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.428984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.429332 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.430096 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:06.430412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:06.431796 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:06.449641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 275/551] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:06.455992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.510586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04917909-f67f-44ac-b03f-0d7b17e2fba6 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.595018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e879c-5ff5-4eee-9be6-2150110d2dbd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.634833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.635645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.635936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.636964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.638383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.638671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.638951 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.639560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.657152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:06.658649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:06.661961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:06.663549 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:06.683804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:06.684965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:06.685940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:06.685940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:06.685940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:06.685940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:06.685940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 276/552] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:06.687384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:06.688352 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:06.689419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:06.691006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.695206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 277/553] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:06.721740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.763368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:06.765207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:06.834884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35a9e7-6a9f-40da-853d-2fe573bdcdb2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:06.880684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:06.881280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:06.881571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:06.881851 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:06.882584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:06.882898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:06.884556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:06.907305 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 277/554] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:06.912858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:06.951366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14857f7-9808-44ec-91ea-32f4809970d1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.014733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.015460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.015746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.016029 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.019697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:07.020031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18173c78-eae8-406e-a603-0cab9b6029e0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.058712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 278/555] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:07.065302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f90d-a099-4139-9d86-e0b346ee286d None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.065878 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f90d-a099-4139-9d86-e0b346ee286d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.066180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5f90d-a099-4139-9d86-e0b346ee286d None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.067738 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 279/556] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:07.068987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f90d-a099-4139-9d86-e0b346ee286d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.081766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.088076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58273e78-26c4-419f-bf6d-e3bf1b613bfd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.137046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.137779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.138321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.138619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.149068 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.150914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.159261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-dc84d59f-0758-4c49-acfd-25f8067d85ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:07.168447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:07.169578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:07.170697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 278/557] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:07.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0611-543d-45c6-87ff-3641b61e7ae1 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.172026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0611-543d-45c6-87ff-3641b61e7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.173125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0611-543d-45c6-87ff-3641b61e7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.187248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5f90d-a099-4139-9d86-e0b346ee286d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.190026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-bd0b0611-543d-45c6-87ff-3641b61e7ae1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:07.191215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-bd0b0611-543d-45c6-87ff-3641b61e7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:07.226172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.226833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.227234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.227518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.269367 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 279/558] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:07.271190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058829f-c59a-43b1-9ad1-b82da1c9d3a3 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.271490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058829f-c59a-43b1-9ad1-b82da1c9d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.271776 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058829f-c59a-43b1-9ad1-b82da1c9d3a3 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.277792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 280/559] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:07.277792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058829f-c59a-43b1-9ad1-b82da1c9d3a3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.309488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.311522 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398de3b-ad6c-457b-90a5-fbc16cd636fb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.381613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.394823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058829f-c59a-43b1-9ad1-b82da1c9d3a3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.396136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.422121 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 280/560] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:07.423488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.423786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.424067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.436303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.437031 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.437314 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.437594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.438889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:07.439201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.440688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.441285 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:07.443363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:07.462864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 281/561] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:07.462864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.524388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 281/562] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:07.525281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.578607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf930b-f71b-4732-a4a5-eabc0baace78 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.615547 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.617243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.617751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.618528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.631695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:07.635059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746df7c-9a5a-4616-aba2-f0719fb2cf05 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:07.642473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:07.643859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:07.645029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:07.645871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.646967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 282/563] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:07.647665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.659447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.678687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.679485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.679775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.680098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.691495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.693091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:07.712230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:07.713239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 282/564] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:07.714605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.760897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83f2d3-e234-415b-a7f6-3a33254d5e17 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.794812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.795605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.795893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.796208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.806828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.808274 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.816198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d35cd-ee4a-4c91-bc87-280883e6995f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:07.825382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:07.826530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 283/565] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:07.828074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.852331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.853159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.853447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.853726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.863859 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-2f49c40e-8d0a-4cee-9621-89582614e3e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:07.871653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:07.872905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:07.873831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 283/566] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:07.875145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c730-0176-44d2-baac-3e3740f57536 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.875302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c730-0176-44d2-baac-3e3740f57536 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.875580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329c730-0176-44d2-baac-3e3740f57536 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.877018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 284/567] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:07.877629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c730-0176-44d2-baac-3e3740f57536 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:07.895973 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.897697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:07.937929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682aa1c1-54f0-4a6b-b686-5aa5e8be29a8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.972159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:07.972845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:07.973155 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:07.973410 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:07.974157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:07.974469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:07.975846 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:07.980461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329c730-0176-44d2-baac-3e3740f57536 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:07.983800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 284/568] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:07.984618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.016364 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.017058 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.017347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.017628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.018360 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.018675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.020064 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.031179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 285/569] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.031964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.088916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cbd33-0e27-4e67-a026-72bdc4fa1a88 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.108020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.108889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.122097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.122761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.123047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.123321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.124040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.124900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.126277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b92b5-c069-4b49-938c-38e6943d157c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.129854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f006-2500-40c0-ae20-a450a8df6123 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.137970 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 285/570] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.139164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.139457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.139734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.157211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:08.158350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:08.164287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.164975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.165261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.165540 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.166296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.166610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.168006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.180504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 286/571] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.180504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.231699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 286/572] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:08.232790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.277769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344b323-0fdc-4de5-98f6-c514d00e511e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.314963 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.316075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.316588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.317065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.328252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.330681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.332199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.334939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c7c15-4a0d-418a-93f5-cf924558aee6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.345524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:08.349390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:08.350368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 287/573] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:08.351412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.373565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.375042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.375321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.375598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.382242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.384489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:08.398785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:08.399886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 287/574] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:08.400922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.457110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc491d34-e312-4bb3-b666-5fc3a2214504 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.490844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.491660 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.491919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.492196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.498152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7f73-f084-4674-83f0-b4c8cb6c445f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.498909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.501034 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:08.515831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:08.516952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 288/575] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:08.517912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.536711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.537514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.537805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.538084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.549229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.550667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:08.568294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:08.569428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 288/576] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:08.570417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.579447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.594973 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.626213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00467-f3e5-436b-8c0e-3929b8c7ccbd None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.659681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.660504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.660795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.661068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.669662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5515b-d2b1-4446-b85d-03aff2fcf2aa None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.671050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:08.679345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:08.680527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 289/577] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:08.681464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.706694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.707418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.707642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.707912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.708662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.709427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.710318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.722321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 289/578] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.723325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.786808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40eff68-5c35-4803-b928-32d7cafa12f9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.799679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.802971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:08.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.820462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc8b3-1440-4d8a-ac16-54af33c1fb7b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.820623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.820910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.821186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.821976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.822288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.823748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.836636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 290/579] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.837430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.859357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.860057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.860344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.860654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.861445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.861760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.863182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.874870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 290/580] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.875677 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:08.938911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c2f54-cf2b-49d7-af72-153b1b56162a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.971827 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:08.972438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:08.972698 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5a957-e06f-486e-b888-c1b266f10192 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:08.972807 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:08.972992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:08.973808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:08.974127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:08.975488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:08.986942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 291/581] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:08.987722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.011739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.012451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.012723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.013001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.013749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:09.014058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.015938 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.017828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.023859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 291/582] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:09.026342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.029034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.086670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246675f1-19f4-45a3-b78b-eac4b5273385 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.120693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.121481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.121765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.122043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.124211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3328f-d1f3-4e64-a770-e3c4a59ff34c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.129070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.130516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:09.145603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:09.146830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 292/583] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:09.148049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.161416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.162174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.162462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.162738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.163556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=7ca5b624358643ddaaf7279a902310fe) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:09.163868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.165322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.170648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 292/584] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/role_assignments?user.id=7ca5b624358643ddaaf7279a902310fe&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:09.171414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.250164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.253315 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.261477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981dd89-0951-4e99-b24d-01852b775b27 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.290481 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfda64-6c09-46fd-acd5-95e43117261c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.299597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.300654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.300999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.301344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.318066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=fe2c18b13963439cbe1685ce9a1f9c4c, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.320136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.326702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.328018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.328298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.328669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.336344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.337810 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:09.352618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:09.353889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 293/585] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:09.355067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.379577 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 293/586] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:09 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:09.380737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.493199 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8b71-228d-4a4f-bcf9-48336bbaa7c3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.529105 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ca036-9995-449e-a1a1-2cd2c6499705 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.536136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.545601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.548564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.548564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.548564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.562312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.564010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.573636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.574460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.574853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.575229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.576175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:09.578450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.578744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:09.583904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:09.584926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:09.585897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:09.585897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:09.585897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:09.585897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:09.585897 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 294/587] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:09.586244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.600716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.605200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 294/588] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:09.605669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.719700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d28793-c415-4fbd-a862-f75a2b2c8ba4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.723141 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0399b7-ad37-4b3c-9b4d-c1d107620629 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.757480 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.758237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.758870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.759236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.760070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:09.760381 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.760649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.761432 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.761806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.761937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.762256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.763293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:09.763699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.765480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.778764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 295/589] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:09.779780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.784592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 295/590] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:09.785814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.829087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.845190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:09.891198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75406f1d-782f-4641-86d6-3d6bf642edb2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.896470 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843bdec-5261-4eb3-8613-2887c7952f8c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:09.928986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.929836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.930081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.930359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.934549 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:09.935602 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:09.936109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:09.936668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:09.943474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.945082 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.945883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:09.947773 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:09.963066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:09.964329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:09.965632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:09.967394 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:09.968590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:09.970655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:09.970655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:09.970655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:09.970655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:09.970986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 296/591] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:09.970986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:09.973065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 296/592] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:09.975130 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.078928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.082872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d217d-ffeb-4933-9557-6bbe38540341 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.117198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a51ac0-d494-4b34-962a-be06fbb54362 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.121480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.122472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.122918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.123377 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.131431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.139699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.141770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.154929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.156217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.156638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.157013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.157842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.158248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.159851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:10.167073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:10.168362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:10.169575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:10.169575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:10.169575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:10.169575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:10.173263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 297/593] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:10.174721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.181010 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 297/594] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.181010 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.300050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671330d-595d-4769-a444-bee0f5f77c44 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.304361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c86fa-ed7b-4207-87ed-5d1e3d0d879b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.344328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.344557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.344939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.345061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.345224 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.345334 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.345501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.345628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.346233 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.346358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.346542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.346652 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.347937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.348073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.361040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 298/595] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.361879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.371587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 298/596] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.372673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.383295 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.395582 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.470316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc41b5f-034e-4ee0-b32e-e3a1cbb5e2eb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.475564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd8589-87dc-48e0-853d-4f4e7ee29876 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.507970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.509058 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.509344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.509620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.512154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.513158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.519219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.519219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.519413 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.519413 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.521689 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.523129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:10.533833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:10.534840 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:10.535821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 299/597] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:10.536351 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:10.541983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:10.542919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:10.543957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:10.548654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 299/598] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:10.549502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.628959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.638205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.648335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f1a2-7422-4d50-9766-7711d7e16307 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.672849 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8993d-cd0e-4db1-9d16-29b06bd53cd3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.692252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.693090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.693377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.693655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.711346 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.712984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.714466 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.721390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.721914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.722386 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.723426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.724368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.726084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:10.734336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:10.735562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:10.736568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:10.736568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:10.736568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:10.736568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:10.736568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 300/599] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:10.736943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.744204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 300/600] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.745344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.868219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f90211-52b7-4b63-809e-1d967ac9f844 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.876574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70ead0-05be-4138-a976-e7259ffd67b1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:10.910366 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.911282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.912152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.912651 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.913134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.914129 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.914628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.916266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.919694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:10.920375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:10.923997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:10.923997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:10.923997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:10.923997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:10.923997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:10.929525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 301/601] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.930558 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:10.936220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:10.944767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 301/602] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:10.945602 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.042888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469264fc-f3b3-4c33-b3af-11291d16687f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.083211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.084520 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.085020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.085306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14c2fa-523c-4df2-815a-d77b87b0e9f7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.085758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/b7d1dca553bc493daf803986df6abac0/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.101598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=b7d1dca553bc493daf803986df6abac0, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:11.103452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:11.122040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.122945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.123230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.123508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/6b419d0f016a46468640dcc675629c4c/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.141172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=6b419d0f016a46468640dcc675629c4c, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:11.152184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244181d-b254-4997-b245-d3ed5e6078ab None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:11.185085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 302/603] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:10 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/b7d1dca553bc493daf803986df6abac0/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:11.186148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.265431 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 302/604] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:10 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/6b419d0f016a46468640dcc675629c4c/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:11.266625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.282373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbfc3-7dba-4a4d-8f40-bfb7eda44aa7 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.282717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbfc3-7dba-4a4d-8f40-bfb7eda44aa7 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.282933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfbfc3-7dba-4a4d-8f40-bfb7eda44aa7 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.286142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 303/605] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:11.290763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.291090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.291328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.309751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:11.310987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:11.358346 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4c9c-ba47-4e75-b8b8-e275812cf42f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.371456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.429357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.430187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.430477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.430761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.433277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 304/606] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:05:11.439583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:11.441363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:11.457481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:11.458517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:11.459737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:11.460213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.460331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 303/607] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:11.465522 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.584245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e84e9-0cac-405a-938e-09d9ff9a29d3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.595527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759376a6-185d-436f-aa01-a3d5a8c6463d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.615274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.627804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.628919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.629390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.629820 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.641314 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:11.646986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.647655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.647943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.648252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.649099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:11.649418 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-b963a086-d7cb-4608-ac83-22e5b715a453 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:11.650756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:11.651883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:11.653234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:11.654179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81f347-2e2b-4005-bf8c-3c9d54708c8c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:11.657714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 305/608] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:11.660230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d245a-d929-42d6-ac26-1dcd849c6312 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.660230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d245a-d929-42d6-ac26-1dcd849c6312 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.660230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d245a-d929-42d6-ac26-1dcd849c6312 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.660230 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 306/609] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:11.661490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d245a-d929-42d6-ac26-1dcd849c6312 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.679378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 304/610] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:11.681227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.681740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.682259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.693960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.701606 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:11.703206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:11.775054 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d245a-d929-42d6-ac26-1dcd849c6312 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.808435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 305/611] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:11.808435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.824673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.825491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.825706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.826483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:11.826783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:11.827100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:11.828563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:11.838523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 307/612] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:11.839365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:11.943045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a621dd-a2b6-4226-9d72-ee9bb4078f5a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.946293 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.950750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:11.967764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116e542-d05e-457a-b563-23fb9239d7ff None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:11.984979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:11.985782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:11.986075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:11.986336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/9b0efc8226b943e583cc04914602f2a2/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.002167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=9b0efc8226b943e583cc04914602f2a2, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.003773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.016292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.017118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.017404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.017681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.028452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:12.037055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:12.038154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:12.039067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:12.043223 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 308/613] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:12.044072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.079391 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 306/614] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:11 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/9b0efc8226b943e583cc04914602f2a2/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:12.080685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.213850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48038175-6fd8-4cae-ad52-015d1b59b156 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.234894 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b5512-cb4e-4792-88e2-b82701ed296b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.257097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.258159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.259006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.259490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.260747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:12.261267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.262956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.273854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 307/615] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:12.284761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.307296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:12.309276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.310097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.310380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.310655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.332049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.334198 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:12.371459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:12.377856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:12.378818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:12.378818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:12.378818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:12.378818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:12.378818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 309/616] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:12.380489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.387502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:12.476238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e28df0-6d7f-4b0c-8723-4afcd71b079f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.511693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed25432-bdcb-4a3f-9bea-92e7b4196af2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.552714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.553846 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.554340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.554849 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.555807 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:12.556332 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.558121 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.572174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 310/617] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:12.577306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.578226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.579045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.579330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.579609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.613283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.614781 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.652768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:12.657046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:12.657991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:12.658966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:12.658966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:12.658966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:12.658966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:12.668749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 308/618] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:12.669618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.691195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ce32b-91d5-4916-8410-645b74017902 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.730006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.731182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.731734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.732223 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] PATH_INFO: `/v3/users/swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.741811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.743572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:12.759584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:12.760684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:12.761695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:12.765235 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 311/619] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:12.773456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:12.841193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:12.910302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee234c91-7637-4555-9ddf-f1d804eddf84 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.922529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cd7e-99b7-4219-9038-c90f4dfe5377 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:12.949223 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:12.961763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:12.962506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:12.964594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:12.964594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:12.964594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:12.964594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:12.966318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:12.987294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:12.993099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.006438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.007189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.007541 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.007825 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.008849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:13.009220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.010616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.031040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:13.038775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.179317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf1fbe-e328-41a0-9352-b61bf348abc7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.216271 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.217475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.218016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.218518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.229788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.231605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.250359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64132d-3e58-46fc-82c4-638c1a6f0e6a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:13.251809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:13.252964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:13.254029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:13.254029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:13.254029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:13.254029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:13.256292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 313/622] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:13.264028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.297822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:13.304589 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:13.329057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.329938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.330226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.330557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] PATH_INFO: `/v3/users/nova` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.357365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.358964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:13.381730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:13.382828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:13.384143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 310/623] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:13.393524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.399198 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10e6de-88a8-4a21-b8a7-edbebe04d70b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.448321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.449421 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.449920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.450430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.451370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:13.451896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.454157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.466631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 314/624] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:13.472390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.596783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:13.608610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede885f9-0eab-461a-b92b-c49ad66cb7f2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.622026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2b812-84c2-4a56-a695-3bf499068930 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.672633 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.673436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.673720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.673997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.681294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.682483 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.682811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.683191 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.683506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.683789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.684697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:13.685016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.686448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:13.696772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:13.697787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:13.698757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 315/625] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:13.709429 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.725799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:13.731744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.781120 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:13.836878 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa1f3c-a4dc-43d6-8c82-257829af8c9b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.839008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317f73b-ce89-4d76-be6b-af15f9570d14 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:13.872450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.873006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.873293 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.873628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.878213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:13.879075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.879528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.879980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.880953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:13.881440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.883156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4c7f4-a006-4cd9-8eae-8709cd23c902 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.897710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:13.899315 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490032e-854d-483b-bfac-1c0544180e2f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.899807 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490032e-854d-483b-bfac-1c0544180e2f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.900414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490032e-854d-483b-bfac-1c0544180e2f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.901964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 317/628] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:13.906152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b627-0d7b-48a7-a02c-436e4c8ad87c None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:13.906412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b627-0d7b-48a7-a02c-436e4c8ad87c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:13.906699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45b627-0d7b-48a7-a02c-436e4c8ad87c None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:13.908588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 318/629] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:13.909377 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45b627-0d7b-48a7-a02c-436e4c8ad87c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:13.927514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:13.947159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:13.948645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fad2b-c64a-4964-9816-a36615276098 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:13.995523 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.023176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45b627-0d7b-48a7-a02c-436e4c8ad87c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.055535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 312/630] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:05:14.056874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80528-a883-4f7b-8c88-52bd69f2c8e6 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.057165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80528-a883-4f7b-8c88-52bd69f2c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.057445 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d80528-a883-4f7b-8c88-52bd69f2c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.060039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.061330 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.062409 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.062966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/7ca5b624358643ddaaf7279a902310fe/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.074876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-c1d80528-a883-4f7b-8c88-52bd69f2c8e6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:14.076083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c1d80528-a883-4f7b-8c88-52bd69f2c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:14.079780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=7ca5b624358643ddaaf7279a902310fe, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.081388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.143273 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 313/631] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:14.144358 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.144679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.144965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.156674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 319/632] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:13 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/7ca5b624358643ddaaf7279a902310fe/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:14.156674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.176886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:14.178103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:14.243331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.265108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 314/633] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:14.266005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.274806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.295392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ec041-b779-4814-be2d-d7308cc133f7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.341992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.343457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.344814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.345108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.362153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.364435 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.381110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f7efc-d9a9-49ed-a8e7-a7573f60d526 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:14.387985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:14.389218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 320/634] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:14.390449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.423486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.424377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.424703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.425777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.438896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-59d3f394-0ed0-4303-98c4-e47a4df9b94f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:14.448818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:14.449845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:14.450794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:14.451518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 315/635] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:14.452543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c9e9-777c-4788-9927-34fa9725cade None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.452824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c9e9-777c-4788-9927-34fa9725cade None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.453107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2c9e9-777c-4788-9927-34fa9725cade None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.457772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 316/636] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:14.457772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c9e9-777c-4788-9927-34fa9725cade None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.500749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663bfb7-2bab-4e58-badb-57f42446fea1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.516732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.534242 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.537038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.537850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.538147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.538408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.549438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:14.557390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:14.558674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 321/637] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:14.560127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.579837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2c9e9-777c-4788-9927-34fa9725cade None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.619727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.620519 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.620797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.620981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.621716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:14.622072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.623408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fed60f-1354-424e-988f-d1eed47834fc None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.640447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 317/638] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:14.640447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.640447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.640447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.654896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:14.656657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:14.680946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1a2fa-c264-4fec-b029-cce3f665ade3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.725275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.725978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.726241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.726517 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.727258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:14.727571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.729035 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.735308 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 318/639] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:14.736682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.740525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 322/640] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:14.740525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.779733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.806017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:14.851871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b8d7-6270-4a46-aa4b-402a9532d93a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.853334 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e3c88-e824-4d7f-8a9f-21b8ffeeecf0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:14.890625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.891423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.891708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.891813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:14.892246 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:14.892879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:14.893165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:14.894094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:14.894414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.896130 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.899125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:14.900618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:14.910418 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 319/641] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:14.910418 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:14.915522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:14.916738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:14.917748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 323/642] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:14.918286 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.022495 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.029395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebee5b-21b1-402a-9309-7bb1865c7968 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.029944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d50d3-cdfe-4028-9730-1dcab23d90cb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.049817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.066780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.066945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.067587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.067706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.067870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.067970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.068151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.068340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.079419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:15.079750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.081274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:15.087301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:15.088297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:15.089241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 324/643] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:15.089984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:15.106311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:15.107336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 320/644] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:15.108330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.203151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8e4f8-c96c-4c40-9dc3-9f4f27cd68aa None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.213307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9cd09-f457-406b-bf0c-15a6cef738a1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.240657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.241767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.242051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.242328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.248221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.248933 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.249227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.249510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.250310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:15.250627 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.252073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.253284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.254712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.270103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 321/645] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:15.271239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:15.273234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:15.274343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 325/646] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:15.275407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.290681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.309744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.386670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c600e92-e3a4-41a0-83fd-e6a55865a85b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.393963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eff2b-e375-4226-98df-9d81d7b0933f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.423178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.423881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.424171 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.424479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.425242 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:15.425557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.426970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.429564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.430228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.430509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.430781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.431491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:15.431798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.433167 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.435708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 322/647] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:15.436229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.455485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 326/648] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:15.455485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.530115 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.539809 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.548969 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b8b17-84ad-47ed-a140-c39bef81da52 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.563856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea2a38-452b-4883-b41c-1b7da29d1c0d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.587684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.588358 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.588673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.588950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.589782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:15.590095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.591525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.608436 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 323/649] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:15.608436 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.610014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.610715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.611000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.611284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.612161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:15.612502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.614067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.633742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 327/650] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:15.634807 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.750704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752ab8f-7e6f-489d-af78-c3aa1cdad0aa None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.769777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49088556-d006-49b4-a6b4-a3990d26e7d5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.796673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.798169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.798169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.798169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.809199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.810375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.810674 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.823452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.824257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.824587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.824866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:15.832051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:15.833201 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:15.834187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:15.834187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:15.834187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:15.834187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:15.834426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:15.834426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:15.836474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 324/651] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:15.838271 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:15.852318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:15.853384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 328/652] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:15.854830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:15.856175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:15.959423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ebfd-e40c-491e-b43f-b4e022bc63f9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.981045 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d39064-16a3-4e1d-b052-d150ffcb3d88 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:15.997765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:15.998575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:15.999479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:15.999775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.007482 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.009252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.021407 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.022069 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.022352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.022635 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.023416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:16.023772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:16.025062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:16.026140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:16.027166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:16.027749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.027833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 325/653] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:16.027833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.039489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 329/654] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:16.039489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.097285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.110011 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.145512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f8f04-8db4-451b-82a9-25ed34546f45 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.153437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb87c0-0a7d-4189-b925-68f127e4e0fe None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.182670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.183603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.184072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.184580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.185615 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:16.186098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.187754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.192150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.192853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.193138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.193417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.194249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:16.194562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.195975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.208191 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 326/655] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:16.209344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.220444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 330/656] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:16.221380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.320454 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3090b-c651-4f36-b261-3ee0a6825021 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.333815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe6a6c-f790-4eba-a4c4-d1c3c60cbac7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.341208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.344659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.354159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.354892 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.355178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.355449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.363252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.364742 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.370632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.371451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.372088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.372643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:16.380183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:16.386431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 327/657] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:16.387488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.449813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.451367 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf1a91-8be2-493a-a260-e4a584971221 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.492026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088953d-ed5d-4128-9046-c0ec94e8dc2a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.529797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.530990 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.531266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.531549 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.565120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 331/658] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:16.565120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37a6b-8d18-444d-9c89-ba2cf2a8199a None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.565120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37a6b-8d18-444d-9c89-ba2cf2a8199a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.565120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37a6b-8d18-444d-9c89-ba2cf2a8199a None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.565558 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 332/659] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:16.568499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37a6b-8d18-444d-9c89-ba2cf2a8199a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.576217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.589959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.603806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.605339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.676900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37a6b-8d18-444d-9c89-ba2cf2a8199a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.716387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 328/660] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:16.716387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.720761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.721557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.721845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.722118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.722961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:16.723271 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.724735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdc60b-0eab-4fe3-82ae-aa9d6659fde9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.742437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 333/661] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:16.745722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.746377 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.747870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.765694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:16.767120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:16.806252 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.822108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c02c86-1ab1-4ced-8b58-4bdc26428158 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.830881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:16.840462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 334/662] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:16.840462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.867663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.868514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.868797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.869072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:16.881110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:16.882675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:16.903263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:16.904332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:16.906363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:16.952545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef5881-c824-47df-b843-515aa818ea71 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:16.989927 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:16.990727 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:16.991013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:16.991286 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.002081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.003650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.019034 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343b354-22cb-4797-8433-fd738a3ec6e4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:17.021531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.022648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 335/664] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.023988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.063004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.063649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.064555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.064555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.073867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.077213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.133944 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dcccc-8315-4658-801c-19585163f1b0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.139406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.140978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.171969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.173368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.173660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.173942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.184472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:17.192424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.193455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 336/665] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.199848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.249113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 330/666] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:17.250312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.295155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.307468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b8296-c30b-4b22-a267-5533b305fac0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.315426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.343827 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.345040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.345710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.346293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.347029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:17.347342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.348754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.358532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7efd4-481a-44e8-8cdb-87dd7426aae3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.360439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 337/667] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:17.361174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.402499 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.403083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.403621 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.403621 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.404374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:17.404732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.406710 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.418265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 331/668] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:17.421667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.470178 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b37c9-e917-4048-aef5-fc5944618ef4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.506614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.507561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.508079 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.508934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.509685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:17.510000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.511485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.525067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 338/669] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:17.525067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.531544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.535909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4d0b7-290f-49d2-8ad3-ab738982533d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.552976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.573911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.574941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.575386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.575814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.591580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.594067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:17.617583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.618793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.619973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:17.619973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:17.619973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.619973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:17.626437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 332/670] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.627449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.629698 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af28d2-5d92-492a-9d6a-f39de7a1650d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.665154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.666180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.666722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.667158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.674593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.676207 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:17.691504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.692659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:17.693831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:17.695715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 339/671] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.696688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.731596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf1383-8699-43a6-a113-986fb053229c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.771385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.772479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.772953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.773482 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.780312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.781794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:17.795622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.796684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 333/672] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.806616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.813234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:17.819885 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543120f-cbeb-4b19-9514-95c5b4192aa1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.856745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.857630 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.857875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.858171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.868448 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.869912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:17.887942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:17.889156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:17.890738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:17.890738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:17.890738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:17.890738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:17.890738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 340/673] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:17.891055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.903239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a293c-276b-44df-8a58-cb88a54a8a21 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:17.936911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:17.937509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:17.937794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:17.938076 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:17.938807 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:17.939122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:17.940544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:17.956650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 334/674] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:17.956650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:17.990848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6f0b9-1e51-4a11-b8c0-78441a1b4176 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.021112 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.025562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.026229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.026514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.026793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.027577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.027888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.029402 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d07754-3613-403a-b5a7-96165ce8239a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.037907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.041393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 341/675] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.042719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cef5b-0102-4660-970d-c7a6710e11aa None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.043017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cef5b-0102-4660-970d-c7a6710e11aa None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.043295 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cef5b-0102-4660-970d-c7a6710e11aa None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.044573 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 342/676] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:18.045353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cef5b-0102-4660-970d-c7a6710e11aa None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.054707 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6a248-8b71-4ae8-b8c3-ed56c535b8f4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.088260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.088943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.089230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.089507 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.090299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.090610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.092054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.103881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 335/677] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.104694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.149551 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cef5b-0102-4660-970d-c7a6710e11aa None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.183484 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251d043-066c-4774-b174-948ff8410718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.184248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d043-066c-4774-b174-948ff8410718 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.184574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d043-066c-4774-b174-948ff8410718 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.184855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d043-066c-4774-b174-948ff8410718 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.185575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251d043-066c-4774-b174-948ff8410718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.185890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251d043-066c-4774-b174-948ff8410718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.187870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251d043-066c-4774-b174-948ff8410718 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.199423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 343/678] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.200803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.201090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.201365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.210535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60078e-8244-4f3d-b9d3-1f467c63fbce None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.217139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:18.218345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:18.239044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.244988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.250796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.250796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.250796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.254232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:18.270981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:18.272025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 336/679] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:18.273429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.274728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.287824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 344/680] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:18.288854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.378860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e261d2-ff94-4949-8149-66a96a545afc None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.388035 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f41495-664d-42f4-a90e-188c288038f3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.411562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.412208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.412522 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.412802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.413631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=b7d1dca553bc493daf803986df6abac0) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.413945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.415375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.421701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 337/681] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/role_assignments?user.id=b7d1dca553bc493daf803986df6abac0&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.422472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.425318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.425987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.426270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.426559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.427394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=6b419d0f016a46468640dcc675629c4c) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.427715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.429214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.440524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 345/682] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/role_assignments?user.id=6b419d0f016a46468640dcc675629c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.441175 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.518366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.549372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.564678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7868-ab22-4cc2-a46b-c0e76ab23af9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.587347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704888c-0e54-4b54-bea0-dd4c15004e1b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.610838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.611674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.612172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.612299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.614553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.614871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.616526 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.632468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 346/683] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.632468 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.634324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.634476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.634703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.634986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] PATH_INFO: `/v3/users/swift` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.645276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.647558 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:18.662860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:18.663961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 338/684] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:18.665246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.781699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c46c5b-d58a-46ee-81af-81a86fef8e8d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.798032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.805141 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6140bd2-03a3-4771-b63c-f4af001e6937 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:18.819800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.820718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:18.820850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.821375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.821754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.833986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:18.842398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:18.845370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:18.846576 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:18.847433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:18.847433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:18.847433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:18.849466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:18.849466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=9b0efc8226b943e583cc04914602f2a2) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:18.849466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:18.852430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 347/685] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:18.852586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:18.852695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.857871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 339/686] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/role_assignments?user.id=9b0efc8226b943e583cc04914602f2a2&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:18.862337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:18.970692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bca9d-6ab6-4bde-9e70-1823155fba78 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.008969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.009833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.010190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.010537 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.011463 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:19.011842 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.013404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.033381 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177e2cd-8899-4285-a93e-241ccae0a66f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.035263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 348/687] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:19.041288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.082997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.094117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.095708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.095996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.096548 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.097342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:19.097662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.099229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.110733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 340/688] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:19.117479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.162947 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908f470-68d6-4d68-aaff-224d60193e58 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.168272 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.199125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.199825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.200115 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.200389 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.239611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1c94-f75f-469d-8297-8723673740bc None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.272749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.274216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.278923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.279737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.280068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.280350 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.292421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.294024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.305390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:19.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:19.321361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 341/689] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:19.323714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.380354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 349/690] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:05:19.386840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.449145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.467825 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d556f6-2224-4a31-b2e4-364b03ac68d1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.505467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2956bf-05df-43fe-b19e-f84f33d7096e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.539037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.539996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.540765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.541158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.541546 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.542498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:19.544488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.546441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.550033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.553685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.553685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.553685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.573955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 342/691] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:19.574509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.575966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.579987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:19.602156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:19.604426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:19.606649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:19.606649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:19.606649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:19.606649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:19.606649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 350/692] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:19.613343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.768221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b6877-c516-472a-86e6-13b1f761e0e2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.801044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36741da7-59e3-4593-a632-9dabb05c31b1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:19.848075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.848779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.849067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.849348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.850080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:19.850394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.851778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.862544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:19.863801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:19.864102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:19.864387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] PATH_INFO: `/v3/users/nova` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:19.866990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 351/693] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:19.872320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.876055 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:19.878390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:19.903168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:19.904263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:19.907367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 343/694] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:19.916959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:19.943662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:19.951747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.037083 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83fa00-1754-4358-9e03-539605febe8d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.054822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332b8fd-ff9a-42e2-b2bd-ae46efa1d32c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.074594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.075278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.075567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.075849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.079879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:20.079879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.079879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.097593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 344/695] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:20.105404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.127929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.129255 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.131013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.132170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.147772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.149573 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:20.178283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:20.179491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:20.180734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:20.186133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 352/696] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:20.193342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.248932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.257096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e53739-52d8-4179-a3e5-47b2209a0b64 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.294730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.295316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.295760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.296047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.357727 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d7d74-fac3-4392-a5c3-a09ceac659b2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.360668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.371420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.377195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.394134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.394850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.395134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.395408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.396194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:20.396548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.397981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.415234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 353/697] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:20.426458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.460820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.488068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 345/698] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:20.510155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.600612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1d4f-27e4-4944-bf90-5b8e8a203694 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.648015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006c19-9de1-4b77-ba10-7fdcbd965649 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.663893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.665054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.665576 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.666205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.685170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.685835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.686157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.686444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.687801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=7ca5b624358643ddaaf7279a902310fe) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:20.688130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.689778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.691056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.693144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.697004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 354/699] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/role_assignments?user.id=7ca5b624358643ddaaf7279a902310fe&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-3ea0a676-de02-4199-abe1-c10651d7befb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:20.733584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:20.734629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:20.735602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:20.735602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:20.735602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:20.735602 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:20.741023 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 346/700] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:20.746355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.798957 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.808803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63741e7-7a5f-4929-b4a5-b88e21ff9bd3 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.809420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63741e7-7a5f-4929-b4a5-b88e21ff9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.809879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63741e7-7a5f-4929-b4a5-b88e21ff9bd3 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.815860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 347/701] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:20.821749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf2e1-f425-4dde-8e40-e6237ec14977 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.822145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf2e1-f425-4dde-8e40-e6237ec14977 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.822506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf2e1-f425-4dde-8e40-e6237ec14977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.864095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a2faf2e1-f425-4dde-8e40-e6237ec14977 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:20.865264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a2faf2e1-f425-4dde-8e40-e6237ec14977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:20.905434 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:20.916176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1e2fa-6823-4a05-b101-c93b89aa179b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:20.955375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:20.955927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 348/702] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:20.956057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.956320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.956685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.957496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:20.957907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:20.959307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:20.959695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b19df-95f6-4117-b1ac-813770c40bb0 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.960192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b19df-95f6-4117-b1ac-813770c40bb0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.960824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b19df-95f6-4117-b1ac-813770c40bb0 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.962323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 349/703] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:20.967974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:20.968339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:20.968715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:20.972499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 355/704] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:20.977996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:20.993398 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:20.995015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:21.079930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 350/705] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:05:21.080712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.084766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.096475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b6ed3-dee9-4158-a184-80a4922db8f0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.133786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.134930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.135423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.135890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.143707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.145416 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:21.160382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:21.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:21.162385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:21.164891 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 356/706] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:21.165852 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.181219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.205924 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca269dc-9e0e-4848-9531-9372e77ccaa0 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.251519 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.252733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.253171 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.253597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.254409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.255929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:21.271944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:21.273292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:21.274334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:21.276856 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 351/707] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:21.277528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999fbfd-5301-4db3-b4ac-1a69c7562962 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.278043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.325253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.326531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.327382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.327671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.343535 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.345795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.358106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:21.371216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:21.372261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:21.373269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:21.373269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:21.373269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:21.373269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:21.373269 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 357/708] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:21.374719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.395633 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637da5-ef12-4d88-b851-2718f1d52702 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.440305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.441022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.441309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.442040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.443122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:21.443462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.445446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.462946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 352/709] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:21.463867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.475152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.491851 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded65dd8-09a8-4ec4-ac44-cd10a3b76813 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.533159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.534532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.534532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.535028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.536004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:21.536457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.538123 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.543492 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 358/710] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:21.544451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.582473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9984020-da63-43ac-a48e-1fc6257c39f3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.619616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.620291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.620625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.620907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.621643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:21.621957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.623354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.632774 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.641772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 353/711] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:21.642674 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.655785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413c8a3-a1d2-4666-8e32-d800123348c0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.693362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.694036 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.694324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.694707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.695653 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:21.695976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.697449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.708087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 359/712] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:21.709470 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:21.714833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.755895 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f39705-d80e-4be5-b1e0-73116438a368 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.807155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.808560 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.809339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.809814 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.811015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:21.812134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.814528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d7edd-5ffb-4a3a-b431-7c82a188e437 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.823292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 354/713] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:21.825686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d568-032c-4ff9-90b5-2d226952af67 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.826147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d568-032c-4ff9-90b5-2d226952af67 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.826603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d568-032c-4ff9-90b5-2d226952af67 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.829390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 355/714] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:21.836970 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a17be-02d2-4dcf-b770-7b6c918d763b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:21.838289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.838743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.839178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.869757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:21.877588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:21.878918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:21.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:21.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:21.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:21.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:21.884966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:21.884966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:21.966722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 360/715] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:05:21 2022] POST /identity/v3/users => generated 254 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:21.991216 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 356/716] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:22.028734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:22.154106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479674-bd76-4f6d-b660-ba4ff3629423 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:22.199418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:22.200228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:22.200543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:22.200822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] PATH_INFO: `/v3/services/network` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:22.201481 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:22.203427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:22.219408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:22.220834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:22.221749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 361/717] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:22 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:22.229554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:22.304776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:22.340237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3ec5f-8bc6-48d3-a49c-76a344ee45ec None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:22.379741 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:22.380452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:22.380750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:22.381035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:22.381761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] RBAC: Adding query filter params (name=network) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:22.382078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:22.383729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2c645-9610-48b1-9a46-ee9cc5560d02 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:22.392237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 357/718] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:22.397362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:22.459686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:22.520572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5ab19-94de-4d00-b186-439d19de854c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:22.558883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:22.559560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:22.559848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:22.560129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:22.560878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] RBAC: Adding query filter params (type=network) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:22.561736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:22.563138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b7622-17cc-4322-820c-aa27cc9e750c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:22.569528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 362/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:23.200396 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1942-e8d7-49f0-83bc-0e87ddb9d9de None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:23.200985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1942-e8d7-49f0-83bc-0e87ddb9d9de None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:23.201467 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b1942-e8d7-49f0-83bc-0e87ddb9d9de None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:23.203294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 358/720] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:23.220380 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:23.221225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:23.221665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:23.243861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:23.245342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:23.335187 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 363/721] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:23.382401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b1942-e8d7-49f0-83bc-0e87ddb9d9de None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:23.525199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b1942-e8d7-49f0-83bc-0e87ddb9d9de None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:23.564060 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:23.579610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:23.580438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:23.580727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:23.581006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:23.595097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:23.603299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:23.604545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:23.605551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:23.610070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 359/722] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:23.616012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:23.688011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:23.762590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814cea9-d3fb-4159-9ead-2b6f949cd593 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:23.815562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:23.816646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:23.817150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:23.817660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:23.818621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:23.819143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:23.820744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:23.835638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 364/723] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:23.841310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:23.974708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdee97-0ab0-4cfc-83dc-a3e9289632f2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.017059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.017864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.018149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.018426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.041173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:24.042643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4db7f805-f3a0-404f-ae31-e1abd4278e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:24.064238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:24.065325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:24.066768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:24.066768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:24.066768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:24.066768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:24.066768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 360/724] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:24.071047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:24.228166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200a8f-f2bc-4484-81c4-8b5ea7e40ea4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.230559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:24.249630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f30-2aed-4a4e-9a2c-b132eebc3618 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.249986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f30-2aed-4a4e-9a2c-b132eebc3618 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.250198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f054f30-2aed-4a4e-9a2c-b132eebc3618 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.251836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 361/725] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:24.256849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.257137 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.257412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.268904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.269581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.269871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.270149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.270878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:24.271190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:24.272674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:24.285008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 365/726] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:24.290361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:24.290914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:24.292128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:24.351500 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:24.424784 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 362/727] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:05:24.475458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:24.593960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea6b05-b09d-47e7-b763-b1b0e31f9afb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.635070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.635800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.636084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.636360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.644439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:24.646347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:24.663794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:24.664928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:24.666340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 366/728] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:24.673497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:24.679344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2cac9-6a5a-4238-bb3f-8a5cb13f5e93 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.728772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:24.734102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.734975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.735330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.735612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.747131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-72fc157b-04b2-4f2f-8a17-f464cb344c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:24.755214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:24.756368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:24.757630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 363/729] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:24.763333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d319-768f-46eb-b554-8ff7dd1e42c8 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.763888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d319-768f-46eb-b554-8ff7dd1e42c8 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.764939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6d319-768f-46eb-b554-8ff7dd1e42c8 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.766571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 364/730] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:24.767542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d319-768f-46eb-b554-8ff7dd1e42c8 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:24.804908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:24.838054 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d0fdf-4012-4a44-b3a4-68f1620983c3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.879059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.880219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.880782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.881238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.881624 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6d319-768f-46eb-b554-8ff7dd1e42c8 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:24.882410 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:24.882889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:24.884771 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3bd3-a036-4352-9b73-c7f2cfb91e06 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:24.908802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 367/731] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:24.910159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.910364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.910615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.918231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:24.918904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.919190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.919468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.920232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:24.920608 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:24.921988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37d294-bc54-4120-b920-6f131963c9eb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:24.926792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:24.927978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 365/732] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc61e5-087d-409f-b32a-4554291c7e3e None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc61e5-087d-409f-b32a-4554291c7e3e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc61e5-087d-409f-b32a-4554291c7e3e None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 366/733] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:24.934760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc61e5-087d-409f-b32a-4554291c7e3e None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.006499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 368/734] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:25.007385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.025867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.047747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.061507 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc61e5-087d-409f-b32a-4554291c7e3e None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.096334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.097048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.097336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.097618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.117996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e0e6e-9d1e-4818-a0dd-75d762110383 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.152824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.153614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.153893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.154174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.163992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.165403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.166521 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.167971 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc154567-7c18-4865-834a-e41b5d3d495a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6684fccc-a318-4544-a4c6-d24ae5dadf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:25.182712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:25.183724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:25.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:25.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:25.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:25.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:25.184754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 369/735] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:25.185316 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.185393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.185662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.202297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:25.203485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:25.255427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.260097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.268823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 370/737] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:25.269095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 367/737] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:05:25.269626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.273806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6974-7949-4e6e-9417-a74472301aa6 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.274147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6974-7949-4e6e-9417-a74472301aa6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.274424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb6974-7949-4e6e-9417-a74472301aa6 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.275704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 368/738] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:25.276392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6974-7949-4e6e-9417-a74472301aa6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.377056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb6974-7949-4e6e-9417-a74472301aa6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.377337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e38a2-d9fe-4918-8eff-59c3b8f6c2b2 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.410539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59905449-1841-4600-a067-127b3ed05565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.410797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.411199 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905449-1841-4600-a067-127b3ed05565 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.411453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.411572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905449-1841-4600-a067-127b3ed05565 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.411743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.411840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59905449-1841-4600-a067-127b3ed05565 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.412023 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.412514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905449-1841-4600-a067-127b3ed05565 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.412779 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:25.413094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.413873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59905449-1841-4600-a067-127b3ed05565 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.414508 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.425815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 369/739] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:25.431039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.474478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.481180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 371/740] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:25 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:25.482460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.483226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.483524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.501471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:25.502704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:25.534670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff7dfe-9835-40d0-b636-6f3e4567cf6d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.578866 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.579691 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.579973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.580244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.591915 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.593499 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.610393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:25.612921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:25.613901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 370/741] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:25.625630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.637933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 372/742] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:05:25.639834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.740471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.746641 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf116-f000-411c-b601-bbfeaa163ea0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.753863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55ec7f-0461-4e01-a8aa-a81387477640 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.785455 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.786366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.786655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.786927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.788813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.789614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.789893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.790168 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.798089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:25.798242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.799627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:25.805850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:25.806833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:25.807749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 371/743] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:25.809205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:25.820570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:25.821637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:25.822781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 373/744] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:25.823440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.874931 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:25.918836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1beea-d2f1-4915-ae99-f35f1615032a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.934945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e612f-1ca2-46ef-8bc2-2297a31fcfc5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:25.954359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.955168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.955455 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.955734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.956486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:25.956800 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.958306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.969612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:25.970270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:25.970560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:25.970837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:25.975853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 372/745] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:25.975999 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:25.976112 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:25.976193 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:25.993987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.040487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 374/746] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:25 2022] POST /identity/v3/services => generated 240 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:26.046023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.095137 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff22eaa-95e8-457b-9633-3ed1a340b16f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.158018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.159045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.159532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.160312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.161893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.162671 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.164622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.182773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 373/747] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.182773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.189148 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acf8c9-90ab-41ab-ac9a-7effb4792bd3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.192263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.236108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.236752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.237037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.237312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.238151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.238462 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.239884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.261781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 375/748] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.262538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.283747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.307281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018718-a7a4-4b87-9a84-fd8746ef2d43 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.344073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.345292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.345807 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.346314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.353558 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.355523 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.370005 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844f780-8a3e-484b-931d-ff100493c040 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:26.371085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:26.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:26.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:26.375601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 374/749] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:26.376652 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.407122 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.407916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.408208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.408532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.419282 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.420932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:26.440299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:26.441561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:26.442539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:26.442539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:26.442539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:26.442539 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:26.449128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 376/750] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:26.450223 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.480834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.498451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1960c1-2912-4f10-8427-2f48e313ec6d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.538880 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.540093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.540650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.541145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.543850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.553280 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.556590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.570304 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c948a6-a9d3-4e63-bab2-5f3cae56390f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:26.574200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:26.575149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:26.576122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:26.576122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:26.576122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:26.576122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:26.584158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 375/751] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:26.585366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.612837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.613519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.613804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.614089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.615321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.615640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.617659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.635135 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 377/752] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.636656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.704639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8cee7-097b-4120-98db-f7c0c5073c6f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.745343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.752926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.753913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.754429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.754928 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.755957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.756633 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.758218 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.776180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d9fb7-b03a-4f36-8a4b-e5f76c901b4f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.776561 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 376/753] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.777659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.824062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.825157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.825752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.826241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.827751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.828292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.829902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.835365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:26.847467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 378/754] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.852540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:26.902900 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f9c9-13c2-44c4-b537-bfd2ff0b8e46 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.945433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:26.946088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:26.946380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:26.946698 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:26.947964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=7ca5b624358643ddaaf7279a902310fe) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:26.948295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:26.950044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:26.957972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 377/755] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/role_assignments?user.id=7ca5b624358643ddaaf7279a902310fe&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:26.958419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afddb3-439a-41b2-ba16-18ca6c73c956 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:26.958765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.005567 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.006327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.006610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.006886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.010193 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.028571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.028571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:27.044052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:27.045801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:27.047276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 379/756] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:27.056464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.209565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cc04e-5ef9-4930-a064-cb7e137b32c3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.250106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f65893-84cc-47b9-963d-22334248381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.251163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f65893-84cc-47b9-963d-22334248381b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.251733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f65893-84cc-47b9-963d-22334248381b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.252233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f65893-84cc-47b9-963d-22334248381b None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.252476 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7bb7b1-5da6-4947-b64c-c4e7ab08e76d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.253593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f65893-84cc-47b9-963d-22334248381b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:27.254172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f65893-84cc-47b9-963d-22334248381b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.255981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f65893-84cc-47b9-963d-22334248381b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.263999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.277095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 380/757] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:27.283555 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f65893-84cc-47b9-963d-22334248381b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.293423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.294238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.294520 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.294795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.303253 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.304763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:27.337254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:27.338339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:27.339325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 378/758] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:27.344902 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.357139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.415466 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f65893-84cc-47b9-963d-22334248381b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.462985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.464153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.464705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.465196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.546045 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.547967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669ca67-ae7d-45b9-ab1a-4817da6418b8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.573594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c67a-240a-40d8-a127-b17c40ba2001 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.648987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.650028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.650552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.651056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.652173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:27.652715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.654365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae74e9-f1a2-49fb-826a-cd2c25fcea89 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.660016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.670923 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 379/759] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:27.673061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc934e-d5c4-4280-8bf3-d2ffbaa67af9 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.673648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc934e-d5c4-4280-8bf3-d2ffbaa67af9 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.674138 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc934e-d5c4-4280-8bf3-d2ffbaa67af9 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.675763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 380/760] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:27.676681 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc934e-d5c4-4280-8bf3-d2ffbaa67af9 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.716860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.728676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 381/761] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:05:27.730293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.730759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.731229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.750485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:27.752132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:27.821584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc934e-d5c4-4280-8bf3-d2ffbaa67af9 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.824024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 382/762] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:27.825152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.887596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.888803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.889625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.889908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:27.892612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=fe2c18b13963439cbe1685ce9a1f9c4c, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:27.894063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:27.925704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:27.943720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca602521-b9aa-4cab-a45c-ed861854cdef None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:27.979964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 381/763] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:27 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:27.981680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:27.991399 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:27.996589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:27.996902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:27.997158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.021758 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.023249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:28.058503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:28.059601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:28.060647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:28.060647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:28.060647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:28.060647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:28.060647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 383/764] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:28.074157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.176345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.190678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce0af-cae9-4cce-abae-a0bddceee728 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.240136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644541b-c88f-4582-b497-86a17f2fd134 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.240995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.243336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.243811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.244264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.245124 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.246700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:28.266947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:28.268004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:28.268988 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.276833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 382/765] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:05:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:28.279921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.289952 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.290630 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.290920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.291203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.291940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:28.292256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.294073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.295456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.306802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 384/766] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:28.312549 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.417754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7c1b0-41e4-4a07-a165-5888c79e230e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.444324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7469528-0692-4c94-b92d-3d88b4a7376e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.452715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.453529 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.453666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.453924 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.454635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:28.454946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.456420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb135d-9c1d-447d-9151-6833d76bbba3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.466030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 383/767] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:28.466030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f67-2cdf-40ce-8011-1ac54fb67273 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.466030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f67-2cdf-40ce-8011-1ac54fb67273 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.466030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2f67-2cdf-40ce-8011-1ac54fb67273 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.468761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 384/768] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:28.469537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2f67-2cdf-40ce-8011-1ac54fb67273 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.489386 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.490499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.490975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.491438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.492654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.499833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.501511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-c39b84c3-325e-4895-9016-1c6f2b6e885e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:28.516651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:28.519594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:28.520589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 385/769] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:28.522689 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.523403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.523883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.541411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:28.542896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:28.575863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2f67-2cdf-40ce-8011-1ac54fb67273 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.604770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.626453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.627438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.627909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.628441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.629343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:28.630002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.631626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.636532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 386/770] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:28.637651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.643499 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 385/771] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:28.649340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.744310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.764428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ace56-de1e-4188-adc7-f04eaab9e79d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.771521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373b6d-d701-44ce-9d4a-b2e1ec2bcbd9 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.804449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.805211 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.805571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.805919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.806791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] RBAC: Adding query filter params (interface=public, service_id=5b4d072476674d5cb54d74fccc1d7d88, region_id=RegionOne) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:28.807179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.808649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.809200 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.810041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.810474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.811536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.812561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:28.813053 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.814642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.817792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 386/772] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/endpoints?service_id=5b4d072476674d5cb54d74fccc1d7d88&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:28.818682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.828344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 387/773] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:28.829491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.877931 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:28.931005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb652c1-ece7-48b4-8c60-ea03ea0b8d84 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.935626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45e304-e57c-4303-a77c-44682f6cba8b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:28.969192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.969913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.970197 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.970472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] PATH_INFO: `/v3/services/network` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.971133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.972536 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.973145 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:28.974042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:28.974561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:28.975037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:28.975927 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:28.977505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:28.984170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 388/774] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:28.985288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:28.985405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:28.986419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:28.987343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:28.991649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 387/775] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:28.992832 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.007382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:29.104664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94a5f-4994-4440-8dee-c4c467f244d9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.117108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:29.126871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b8f68-116f-45ed-b98f-17ca7c440526 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.155777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.156488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.156779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.157055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.157902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=d38e114f2351455bb94a6d2272b0bdd1) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:29.158218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:29.159708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:29.176278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 389/776] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/role_assignments?user.id=d38e114f2351455bb94a6d2272b0bdd1&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:29.199340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.200036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.200320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.200618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.201405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] RBAC: Adding query filter params (name=network) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:29.201722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:29.203133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc23522-4ac5-4db3-85af-eb9d321202db None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:29.208940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 388/777] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:29.214636 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.333021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623bb6-3607-4156-a7e7-9dc82ed39093 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.347420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751671-750f-4d09-bdc5-adb09db1d12c None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.347778 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751671-750f-4d09-bdc5-adb09db1d12c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.348301 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47751671-750f-4d09-bdc5-adb09db1d12c None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.350226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 389/778] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:29.357186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.357806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.358172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.384492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:29.385753 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:29.393143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.393829 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.394108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.394383 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.395249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] RBAC: Adding query filter params (type=network) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:29.395529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:29.396936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:29.410205 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 390/779] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:29.414296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.488779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:29.542777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 390/780] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:29.560017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c406c5a-f7d4-4cea-a259-9a5975545c63 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.573169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.581477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:29.605497 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.606139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.606427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.606707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.607501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] RBAC: Adding query filter params (interface=public, service_id=24bcba889c164d45b4089a2e4dcdc37b, region_id=RegionOne) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:29.607849 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:29.609518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:29.627425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 391/781] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:29 2022] GET /identity/v3/endpoints?service_id=24bcba889c164d45b4089a2e4dcdc37b&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:29.633620 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.739081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82923c8-7b35-4a36-b19d-dae7a1f789c1 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.801656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.802463 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.802736 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.803014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.820641 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:29.824922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:29.828592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d84d12-37d4-42ad-9cc4-58edca979189 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:29.830409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:29.831437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:29.832392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 391/782] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:29.842496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:29.888375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:29.889961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:29.890446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:29.890921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:29.891795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:29.893378 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:29.899607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 392/783] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:29 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:29.956126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:30.004333 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32379c-a270-40f2-b246-243d979101f8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:30.051196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:30.051885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.052164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.052469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.053245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:30.053555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:30.054962 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:30.069652 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 392/784] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:30.071413 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.176076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551aa577-a0a9-4488-ae2e-8ac83f07082d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:30.210594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:30.211440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.211664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.211933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.223710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:30.225297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:30.244376 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:30.245395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:30.246391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:30.246391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:30.246391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:30.246391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:30.248962 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 393/785] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:30.252446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.388564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791098d6-5690-40e3-a4f9-95ba7ba8e25f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:30.414414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:30.423517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:30.424187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.424539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.424825 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.425552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:30.425862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:30.427366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7089d611-50e5-4adc-8b9a-4f4d7c63e15f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:30.444073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 393/786] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:30.445523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.451174 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4501-92cb-44e7-97ec-623fadc18de5 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.451490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4501-92cb-44e7-97ec-623fadc18de5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.452189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d4501-92cb-44e7-97ec-623fadc18de5 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.454180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 394/787] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:30.459456 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.459751 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.460030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.477937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:30.479167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:30.491757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:30.612553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 395/788] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:30.640674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb63ea-17d9-4bc0-b32d-2a10f0d07c8b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:30.655714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.698632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:30.699790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.700438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.700733 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] PATH_INFO: `/v3/users/swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.715450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:30.715450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:30.749546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:30.750668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:30.751692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:30.752809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 394/789] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:30.759088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.832111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d349b-45da-470c-8978-37e6b12aa9d5 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:30.863699 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:30.902114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:30.902936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:30.903219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:30.903495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:30.908750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:30.926571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:30.934526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:30.935539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:30.936703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 396/790] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:30.943626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:30.958237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b0adf-af72-4e93-a818-795ff7528b2d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.024697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.025390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.025677 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.025953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.026799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:31.027112 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.030654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.051476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 395/791] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:31.056881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.153451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0778cca-a5e6-4eae-9207-27c1f38d238e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.215792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.217047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.218567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.219071 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.220224 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:31.221512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.223745 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.244845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55a0c-e315-422f-8f0f-f6342a5a1a00 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.246594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 397/792] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:31.249314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.310194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e744-e002-430d-878b-2135c89d854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.311612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e744-e002-430d-878b-2135c89d854e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.311917 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e744-e002-430d-878b-2135c89d854e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.312232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441e744-e002-430d-878b-2135c89d854e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.314408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:31.323653 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441e744-e002-430d-878b-2135c89d854e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.324728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:31.325137 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441e744-e002-430d-878b-2135c89d854e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-b441e744-e002-430d-878b-2135c89d854e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:31.359546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:31.360625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:31.361625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:31.361625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:31.361625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:31.361625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:31.363834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 396/793] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:31.367818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e744-e002-430d-878b-2135c89d854e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.442429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b0be3-d243-4999-ab57-8e3392dd33f1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.484950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.485684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.485973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.486254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.499118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.500700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:31.521750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:31.522793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:31.523758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:31.523758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:31.523758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:31.523758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:31.523758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 398/794] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:31.534524 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.579511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441e744-e002-430d-878b-2135c89d854e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.625706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.626679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.626961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.627239 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.628134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:31.628792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.630453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d36c20-b749-45c4-8eb7-a32f9787e8ae None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.644764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 397/795] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:31.645932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4f71-cec3-4765-a452-dd3840e64ce8 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.646222 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4f71-cec3-4765-a452-dd3840e64ce8 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.646500 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab4f71-cec3-4765-a452-dd3840e64ce8 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.651861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 398/796] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:31.653065 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327be1a-2c27-4981-ba39-ee1e19b25e63 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.653350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327be1a-2c27-4981-ba39-ee1e19b25e63 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.653623 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327be1a-2c27-4981-ba39-ee1e19b25e63 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.656461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 399/797] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:31.656461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327be1a-2c27-4981-ba39-ee1e19b25e63 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.669496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:31.679517 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13f05-a763-4add-8b64-ec0435f01b1a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.710955 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:31.720698 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.721466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.721757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.722040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.722845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:31.723415 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.724601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ede09-1092-4ff1-87c8-1668480cdba2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.736716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 399/798] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:31.738247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd8c0-1a91-4d55-a529-43c421a48dae None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.738726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd8c0-1a91-4d55-a529-43c421a48dae None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.739172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfd8c0-1a91-4d55-a529-43c421a48dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.756605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-10cfd8c0-1a91-4d55-a529-43c421a48dae None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:31.757777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-10cfd8c0-1a91-4d55-a529-43c421a48dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:31.777250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327be1a-2c27-4981-ba39-ee1e19b25e63 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.813886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:31.814688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.815035 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.815319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.822409 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:31.823855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:31.832720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 400/799] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:31.832720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:31.832720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:31.832720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:31.846042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:31.847042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:31.847997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:31.848700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:31.849622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:31.852761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 400/800] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:31.853648 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.921658 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 401/801] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:31.924623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:31.933833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:31.977089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f80-8f12-487d-95d2-b796865645cf None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:31.984173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.014644 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.015368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.015653 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.015928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] PATH_INFO: `/v3/users/nova` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.023506 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.024988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.033431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6571766-1ad3-4efc-80a7-782c61d7f258 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:32.039056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:32.040084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:05:32.041188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:32.044818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 401/802] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:32.045634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.072118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.072812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.073101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.073388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.074182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:32.074497 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.075945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.088812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 402/803] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:32.094195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.152607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b44ce5-d6e4-4161-88c1-55b513519282 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.163856 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.188165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.189055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.189347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.189634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.198428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f59597-edc0-49a7-b266-362e6cc9e07c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.200182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:32.208654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:32.209678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:32.210606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 402/804] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:32.211385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.239328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.240248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.240369 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.240485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.240711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.241443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.242740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:32.256172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:32.263635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:32.264841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 403/805] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:32.265986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.324933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424f88a-7bfb-4252-a3a8-aadb5d1fbeb7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.365828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.366815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.367313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.367780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.368831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:32.369325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.370921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.373921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d068de-8af4-48cd-93cd-229ebd73e977 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.390455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 403/806] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:32.391652 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.414127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.415565 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.416159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.416473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/7ca5b624358643ddaaf7279a902310fe/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.419022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=7ca5b624358643ddaaf7279a902310fe, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.421050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.423288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.476557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.492379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0d924-76a8-4154-a788-2ff2f52fe534 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.509511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 404/807] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:32 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/7ca5b624358643ddaaf7279a902310fe/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:32.510337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.530238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.530963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.531292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.531762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.532782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:32.533099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.534562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.550768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 404/808] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:32.550768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.624264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498d995-aa9e-454e-b787-abd081240643 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.665206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.665905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.666046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3d15-72df-47fa-a8d7-2e9aacbccdf2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.666460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.666460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.667326 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:32.667537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.670628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0e75c-037d-49c4-8421-afc0c8ff713c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.676154 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 405/809] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:32.677803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d44be-de66-438f-b7b9-9867c8283e61 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.678433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d44be-de66-438f-b7b9-9867c8283e61 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.678728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d44be-de66-438f-b7b9-9867c8283e61 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.680755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 406/810] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:32.681435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d44be-de66-438f-b7b9-9867c8283e61 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.702763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.703420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.703702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.703977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.722153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.756779 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.782735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.784121 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08983a60-7417-423f-b180-47eb0eaeb121 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.803648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d44be-de66-438f-b7b9-9867c8283e61 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:32.840919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:32.841744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.842057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.842342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.852609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:32.854075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:32.874295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:32.875345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 407/811] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:32.876312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.903419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 405/812] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:05:32.903419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:32.903419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:32.903419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:32.916741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:32.917926 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:32.959981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:32.988451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 406/813] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:32.988451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:32.998900 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b0482-6130-4727-9f85-366bac1c195c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.012915 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.039739 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.040461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.041397 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.042405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.043153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:33.043719 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.046005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.057277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 408/814] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:33.057277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.096768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca49b4f-3870-4917-8f84-8c1862d53156 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.134413 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.135244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.135525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.135796 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.136542 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:33.136850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.138208 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.149729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 407/815] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:33.150885 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.173297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d4e2-5cb2-49a0-956e-e8e975370bde None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.190878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.210376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.210872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.211187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.211473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.222627 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.224092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:33.242708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:33.243740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 409/816] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:33.244767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.265630 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6aa9-0ab0-4ea1-a84c-4cb0a8fc826d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.275549 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.303026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.303754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.304028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.304311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] PATH_INFO: `/v3/services/network` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.304985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.306343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:33.319032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:33.320171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:33.321126 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 408/817] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:33.322108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.362104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70fd98-1c09-4e59-85d9-bd6340c5da24 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.400098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.401034 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.401649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.401938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.402849 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.404782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.421732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.424534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc11cf7-d1e6-492d-8976-1604ac9bfc64 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.457075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.457878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.458157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.458433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.465363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.467336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:33.482213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:33.484059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 409/818] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:33.485278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.522010 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 410/819] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:33.522839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.611173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736aa6f-98f9-4186-97ea-cd5c29fb62cc None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.637907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.659236 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccbf6f-bd0f-4cad-a993-386bd22b122a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.665818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.666560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.667097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.667097 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.667839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:33.668154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.669695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.685131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 410/820] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:33.686176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.704233 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.706758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.707273 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.707776 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.709758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] RBAC: Adding query filter params (name=network) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:33.710322 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.712887 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.713981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:33.720002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 411/821] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:33.721190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.839424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6f93-f70b-4a57-8133-b83c59ff50f7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.844310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fb3fe-79f3-4dde-a037-876ead42d1ca None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:33.885853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.886444 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.886725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.887003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.887832 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:33.888141 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.890110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:33.893401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:33.893904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:33.894382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:33.902122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:33.903801 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:33.913059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 411/822] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:33.913059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:33.925168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:33.926150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:33.927117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:33.931407 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 412/823] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:33.932498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:33.936429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.016374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.050419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bacf7-2910-44c1-a1ec-caf4d2cce80a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.061895 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d28c00-a423-46a7-b7e7-4fec0ba5aac7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.105041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.105710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.105995 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.106275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.106985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] RBAC: Adding query filter params (type=network) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:34.107325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.108726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.114179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 412/824] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:34.114973 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.115918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.116972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.117728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.119138 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.134715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.137119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:34.162424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:34.163451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:34.164472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:34.164472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:34.164472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:34.164472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:34.171791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 413/825] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:34.171791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.230780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.252233 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf380c31-f314-4304-8f5b-6f82ce6ca25d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.280145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5393ea0-e24c-40c5-bfee-9d4220cc328b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.295972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.297029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.297490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.297913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.298893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:34.299522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.301231 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.309218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.320847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 413/826] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:34.321802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.329180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.329180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.329180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.329180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.329544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.329544 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.413885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 414/827] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:34.413885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.454457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581434d6-fbf7-4b40-85eb-bc83da356bad None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.513882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.514567 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.514854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.515133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.515980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:34.516182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.517637 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.544373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 414/828] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:34.551873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.575907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc7bc7-1e6f-4e10-a5da-bc8cccfe961a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.589379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.618262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.619358 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.619953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.620528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.621651 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:34.622193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.624732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fa2b7-0d6f-4f15-ae41-afa8a4353fd5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.634238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.635336 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 415/829] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:34.637205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6126f-2b59-49aa-a342-306214bf6a8b None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.637733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6126f-2b59-49aa-a342-306214bf6a8b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.638372 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6126f-2b59-49aa-a342-306214bf6a8b None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.642718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 416/830] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:34.650219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.650457 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.650678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.679935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:34.681670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:34.714781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5d9ca-f04f-40ea-ad21-ae1d17792467 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.760963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.761852 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.762144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.762425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.771508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.773050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.784724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 417/831] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:34.793454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:34.794472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:34.796837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 415/832] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:34.801077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.811620 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:34.938894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83215106-4e68-4c44-ab26-9b13d9443175 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.947210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.954657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352d9c-ff8b-429e-972f-ae9ca7af9094 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:34.978124 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.979015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:34.979365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:34.979714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:34.980605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:34.981033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:34.982128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:34.983584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:34.997712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:34.998888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.003478 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 418/833] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:35.003599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.003599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.005275 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.014129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:35.022501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:35.023561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:05:35.024941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:35.027572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 416/834] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:35.034370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.125085 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa93bf-5e81-4947-a40b-13aeb2515849 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.144764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be147980-77b0-4e79-8f53-8407ed17778e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.166584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.167861 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.168212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.168581 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/d38e114f2351455bb94a6d2272b0bdd1/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.187118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=d38e114f2351455bb94a6d2272b0bdd1, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.188340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.188797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.189541 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.190040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.190510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.191645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:35.192752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.194371 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.203345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 417/835] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:35.208842 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.247131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:35.284677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 419/836] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:35 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/d38e114f2351455bb94a6d2272b0bdd1/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:05:35.326924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6766afa-cfae-4e65-aadf-43e71590aad9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.368608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.369905 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.370450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.370941 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.383259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.385627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:35.408308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:35.409387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:35.410358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:35.410358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:35.410358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:35.410358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:35.412854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 418/837] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:35.421111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.441278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:35.532077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14fd4-d4d9-40a6-b8a1-9ca6e2af8cd1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.567093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.567764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.568047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.568321 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.569075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:35.569380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.570746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37718058-8448-4c7e-b018-fe263c4c6bbf None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.583158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 420/838] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:35.588602 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.682811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:35.713033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d8cfb-32fb-44c8-8587-98eec56feb96 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.736999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2a22-f916-44c0-88cc-dfeceb18815f None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.737330 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2a22-f916-44c0-88cc-dfeceb18815f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.737573 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2a22-f916-44c0-88cc-dfeceb18815f None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.739205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 421/839] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:35.741940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.742847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.743138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.743418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.744194 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.744511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.744793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.752143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.753756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.765279 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:35.766488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:35.769676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:35.770695 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:35.771712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 419/840] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:35.782641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.849685 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 422/841] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:35.871514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.875377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:35.895834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb760d-e71c-4630-81a0-be11b8d0bd22 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:35.936569 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:35.937255 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:35.937536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:35.937809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:35.938933 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:35.939245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:35.940900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:35.966599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 420/842] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:35.971531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:35.980704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.014729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de50fb2-0562-4280-8b5c-e35ef37e1bfd None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.064357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.065512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.065955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.066409 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.067340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.069030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:36.082623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:36.084078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:36.085298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:36.087185 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f4d52-a9ad-47a7-af88-131a5e5e3716 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.088082 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 423/843] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:36.095090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.130605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.131880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.132649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.133806 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.176669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.213344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.214783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.220653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58db041-26d3-4753-a20b-eebbe34068db None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.222597 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.258207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.259466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.259960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.260496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.261411 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:36.262002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.263622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.270139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 424/844] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:36.275623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.330330 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 421/845] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:05:36.337434 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.416547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a8d8f-3441-4805-a817-55814972d734 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.454863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498977d4-4f92-4eca-8fef-61bdf30e0638 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.459110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.464608 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.467158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.467438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.467913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.472149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.472149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:36.472149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.472149 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.480443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 425/846] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:36.506100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.507889 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.509150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.509818 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.522820 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.524681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:36.546523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:36.547749 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:36.552760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:36.552760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:36.552760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:36.552760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:36.552760 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 422/847] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:36.556491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.670689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409ef81-665e-45b3-8fe5-4d38bbfff1ad None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.709386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.709918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.710204 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.710482 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.711217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:36.711530 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.713048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.729761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 426/848] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:36.735611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.840795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a963e-6fc7-4602-8ee8-e87909b31c34 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:36.876945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:36.877756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.878043 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.878323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.886000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:36.887538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-df6342ff-e720-4dbc-a645-d16da7beb1fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:36.902615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:36.903763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:36.905529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:36.908333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 423/849] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:36.913599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:36.935813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9f3e-2836-4f33-97ef-1a19378c4227 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.936384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9f3e-2836-4f33-97ef-1a19378c4227 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.936884 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9f3e-2836-4f33-97ef-1a19378c4227 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.938721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 424/850] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:36.943832 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:36.944322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:36.944861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:36.962989 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:36.964628 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:36.979934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:36.981224 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:37.026746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4379caf-8f12-41c4-8287-a47e80e174f3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.060551 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 425/851] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:37.068941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.069834 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.070309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.070797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.071802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:37.072304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.074001 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.083358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.089637 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 427/852] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:37.095683 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.202203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809ac29-1ef7-4587-aa0f-6b342e49789b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.225243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370e565-74f8-4125-af8b-5df9e258d7ab None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.239932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.241050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.241761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.242210 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.243192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.244909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.246270 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:37.259996 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:37.273789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:37.274919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:37.276046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.276136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.276136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.276136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.276136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.276516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=7ca5b624358643ddaaf7279a902310fe) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:37.276516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.277014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.283894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 428/854] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/role_assignments?user.id=7ca5b624358643ddaaf7279a902310fe&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:37.292458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:37.385474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d32241-21db-4e02-bc60-9227e701be22 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.423866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.424751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.425151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.425536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.426374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:37.426792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.428425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b12cbe-6072-42ab-a4c6-b401c8b6fc2f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.437776 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 427/855] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:37.440717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.466172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343756-841b-4178-b0a6-67f95f7363bb None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.466594 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343756-841b-4178-b0a6-67f95f7363bb None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.466958 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17343756-841b-4178-b0a6-67f95f7363bb None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.468691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 428/856] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:37.475307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.475610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.475875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.497394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:37.499422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:37.576089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf562e7-0dd3-4604-a1ce-39baf4176cbb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.591057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 429/857] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:37.612739 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.613707 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.614151 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.614609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.615797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:37.616127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.616505 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.618053 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.624106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 429/858] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:37.648819 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:37.743270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f14fc4-754d-41ba-9375-e7d809d10bac None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.781959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.782697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.782985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.783268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.795932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:37.803855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:37.804937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:37.806873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 430/859] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:37.813523 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:37.867659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:37.923161 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467f34-d0a9-42aa-afb0-7db6623a68c3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:37.957423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:37.958100 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:37.958387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:37.958666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:37.959423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:37.959736 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:37.961140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:37.970316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 430/860] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:37.975728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.048801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:38.084823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb72c-e0b4-4194-a869-3aabd5b46008 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.121127 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.121942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.122228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.122507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.134347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.135881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:38.153812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:38.155369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:38.156346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:38.156346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:38.156346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:38.156346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:38.156346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 431/861] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:38.161650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.267155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b21ed-9d0d-4dc1-b363-c6863613970a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.274390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:38.302497 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.303116 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.303405 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.303686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.304509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:38.304830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.306276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.318549 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 431/862] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:38.324091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.434361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57436a8d-8bd2-4355-ad66-5f9a5cbfc3b9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.452692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:38.469894 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.470743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.471036 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.471319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.479375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.480881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-414aa2a7-ad8f-4131-aeea-d3e75b8c1dae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:38.497318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:38.510904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:38.513055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 432/863] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:38.514410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.613869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d436adc-a0ed-4d7f-8a9b-b22d4fcb091d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.649035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.649740 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.650090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.650395 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.651245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:38.651563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.653102 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.656910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab85b-cea3-40ed-be3d-938fc7994f5f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.658022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab85b-cea3-40ed-be3d-938fc7994f5f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.658318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab85b-cea3-40ed-be3d-938fc7994f5f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.659960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 433/864] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:38.665446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.665736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.666019 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.674115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 432/865] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:38.681818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.687612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:38.689033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:38.721104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:38.781004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 434/866] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:38.804427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:38.812977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b1898-6b4f-410e-97ce-861a751ab216 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.852999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.853757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.854044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.854424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.909906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9163d-ce71-4911-845a-bf9945ec9f98 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:38.919427 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:38.930381 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.931901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.946300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:38.946982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:38.947268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:38.947550 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:38.948280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:38.949765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:38.957689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:39.012575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 435/867] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:38 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:05:39.047017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 433/868] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:05:39.052751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.174405 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922394c-cca7-4e19-b509-b6925191b406 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.212360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:39.213221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.213505 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.213778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.226088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:39.227615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:39.247568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:39.248664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:39.249679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:39.249679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:39.249679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:39.249679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:39.249679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 436/869] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:39.255925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.361428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fe60e-c8bb-43af-b19d-283ef0da7f78 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.386790 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:39.398862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:39.399861 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.400363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.400946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.413119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:39.413119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:39.413119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23830a23-af91-4d14-8527-9022ddb1f9a9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:39.418129 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 434/870] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:39.423848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.444426 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:39.533664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f7a98-bdcc-4686-9124-a7b500c1202a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.548229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd002e-f05b-41ca-8726-645ed5601322 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.549058 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd002e-f05b-41ca-8726-645ed5601322 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.550008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd002e-f05b-41ca-8726-645ed5601322 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.552430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 435/871] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:39.557349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.557639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.557921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.575183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:39.577184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:39.578494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:39.579734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.581070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.581355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.590224 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:39.591899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:39.610734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:39.611711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:39.612737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:39.616490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 437/872] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:39.617939 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.656688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 436/873] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:39.674401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.718263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:39.748343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa6738-5254-4dbd-9ab7-36abccc22f42 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.785531 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:39.785918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.786206 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.786483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.787275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:39.787622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:39.789055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7990c4-619c-43da-9ade-414631fb0472 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:39.802780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 438/874] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:39.804221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f638b5-b211-4f2f-ba51-72f26418f976 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.804543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f638b5-b211-4f2f-ba51-72f26418f976 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.804822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f638b5-b211-4f2f-ba51-72f26418f976 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.806268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 439/875] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:39.809563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbb12e-e825-4c6d-b16e-4a5ef100fc05 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.811902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.812202 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.812527 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.827993 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:39.830755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:39.831948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:39.850537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:39.851357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:39.851645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:39.851926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:39.852612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:39.854002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:39.867830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:39.869028 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:39.869975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:39.875779 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 437/876] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:39.876732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.920680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 440/877] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:39.924603 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:39.987289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0524b8c-9b59-4160-b649-6e2f21737226 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:39.992243 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:40.024735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:40.025842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:40.026279 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:40.026580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:40.027425 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=d38e114f2351455bb94a6d2272b0bdd1) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:40.027744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:40.027958 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb21174-932e-4c7d-888e-270d6d424657 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:40.029237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:40.048433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 438/878] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/role_assignments?user.id=d38e114f2351455bb94a6d2272b0bdd1&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:40.048433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:40.068621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:40.069303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:40.069587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:40.069866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:40.070584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:40.070895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:40.072297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:40.078131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 441/879] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:40.083822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:40.108826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:40.197989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5061e8-7bc0-4ef6-9410-26425f2b8d1a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:40.206951 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0d491-a86c-4808-a8fb-7efa2de925d7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:40.241288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:40.246648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:40.247341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:40.252799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:40.252799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:40.253037 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:40.253148 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:40.253238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:40.253238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:40.253238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:40.253501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf8147-792c-4b7a-b1bd-8b95bffdbf41 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:40.253590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:40.253590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:40.253590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfe47-808b-4dcc-bcad-0eaf2277d1f0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:40.258877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 442/880] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:40.340306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 439/881] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:40 2022] POST /identity/v3/services => generated 269 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:41.223831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa1ad-3263-467b-9b81-df33016ae80b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.224384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa1ad-3263-467b-9b81-df33016ae80b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.224384 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fa1ad-3263-467b-9b81-df33016ae80b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.226095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 443/882] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:41.231451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.231841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.232575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.250077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:41.251275 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:41.326594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 440/883] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:41.350700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa1ad-3263-467b-9b81-df33016ae80b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:41.459550 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fa1ad-3263-467b-9b81-df33016ae80b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:41.499422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:41.500151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.500464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.500750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.501404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:41.502778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:41.516051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:41.517331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:41.518249 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 444/884] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:41.524046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:41.552780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:41.625640 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11d98-35c5-46c3-a9a8-b0c91594a642 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:41.660793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:41.662037 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.662323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.662603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.663320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:41.663635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:41.665059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:41.670230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 441/885] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:41.675587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:41.749234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:41.794085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812f2e6-4e75-40a1-9a9f-610e41336ef8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:41.831653 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:41.832327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.832643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.832922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.833631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:41.833942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:41.835319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:41.840673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 445/886] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:41.849515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:41.944030 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:41.954185 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea56d-2be3-4b09-9717-f3afb224114e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:41.991097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:41.992131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:41.992667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:41.993165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:41.994175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] RBAC: Adding query filter params (interface=public, service_id=02ee3268fefd4c64b4bd6c12c7886d6f, region_id=RegionOne) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:41.994732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:41.996472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc278-e5f6-4f20-8b09-efa0bf418594 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:42.003160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 442/887] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:41 2022] GET /identity/v3/endpoints?service_id=02ee3268fefd4c64b4bd6c12c7886d6f&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:42.009219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.113923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cac11-a686-44d6-a376-c8d6bb02407b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:42.137949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:42.149920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:42.150592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.150879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.151160 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.151845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:42.153265 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4e310-4b39-4c07-bd1b-700977a41d45 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:42.159340 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 446/888] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:42 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:05:42.367077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f369b1-6fa1-4a18-aedf-0ec32f95144e None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.367574 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f369b1-6fa1-4a18-aedf-0ec32f95144e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.367676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f369b1-6fa1-4a18-aedf-0ec32f95144e None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.369271 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 443/889] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:42.374616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dada1d-bbb9-4103-bc9a-5f33dbeaaeb2 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.375071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dada1d-bbb9-4103-bc9a-5f33dbeaaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.375265 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dada1d-bbb9-4103-bc9a-5f33dbeaaeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.384070 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd6ca-cf22-46de-8086-8a04b1a2e4fb None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.384379 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd6ca-cf22-46de-8086-8a04b1a2e4fb None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.384663 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bd6ca-cf22-46de-8086-8a04b1a2e4fb None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.386276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 444/890] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:42.391342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3e879-9668-4d2a-b7b2-e3a67ae02b9f None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.391630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3e879-9668-4d2a-b7b2-e3a67ae02b9f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.391910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3e879-9668-4d2a-b7b2-e3a67ae02b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.394114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a0dada1d-bbb9-4103-bc9a-5f33dbeaaeb2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:42.395318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a0dada1d-bbb9-4103-bc9a-5f33dbeaaeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:42.408960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-68b3e879-9668-4d2a-b7b2-e3a67ae02b9f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:42.410141 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-68b3e879-9668-4d2a-b7b2-e3a67ae02b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:42.481359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 447/892] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:42.484498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 445/892] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:42.492579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118834d5-131c-447d-a973-ae73f4b52fe6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.492870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118834d5-131c-447d-a973-ae73f4b52fe6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.493148 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118834d5-131c-447d-a973-ae73f4b52fe6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.494747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 448/893] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:42.500026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.500322 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.500641 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.504917 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118834d5-131c-447d-a973-ae73f4b52fe6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.521365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:42.522567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:42.592717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 446/894] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:42.601295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.619218 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118834d5-131c-447d-a973-ae73f4b52fe6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:42.624691 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:42.636561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:42.660442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:42.660442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.660442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.660442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.660901 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:42.660901 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:42.713544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 449/895] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:42 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:05:42.716919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.718556 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffeff4f-5b7a-4c46-82a3-c056ae79958a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:42.783664 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:42.784542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.784834 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.785117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.802356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:42.814147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:42.815277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:42.816657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 447/896] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:05:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:42.822180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.852339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81603c99-7cc5-4d9c-8e27-e2efdabf4e7f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:42.896280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:42.897412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.897858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.898316 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.899162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:42.900577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:42.915483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:42.916601 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:42.917540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:42.918418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 450/897] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:05:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:42.924268 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:42.925636 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:42.955946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8fbe-8bb2-4395-b640-b3606a6e3b30 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:42.990633 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:42.993113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:42.993826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:42.994127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:42.994408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:42.995169 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:42.995486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:42.997037 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.005845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 448/898] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:05:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:43.011219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.058454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7648b45-0395-4a87-a340-7e494e2094b6 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.102151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.102828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.103118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.103403 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.104116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:43.104458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.105853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.115773 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 451/899] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:43.117013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.140934 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d405-779b-4392-ba1a-fa485f510e76 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.179453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.180672 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.181175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.181737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.184006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.194817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.198795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:43.216021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:43.217170 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:43.218144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:43.218144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:43.218144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:43.218144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:43.218144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 449/900] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:43.223118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.223523 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b95b3c0-8087-4d32-8eb8-d231f9dd878c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.226934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.267861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.267861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.267861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.267861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.268339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:43.268339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.268339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.278354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 452/901] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:43.284021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.371023 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e6daf-5585-47b2-b796-aaba48579e48 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.408006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4ad79-9e99-4186-a07c-8b90f8354eef None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.408846 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.409587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.409939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.410287 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.411101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:43.411479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.413000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.425793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:43.430888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.453160 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.454173 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.454699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.455190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.456192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] RBAC: Adding query filter params (interface=public, service_id=8613969726a34f6fa025df65da0e1e0a, region_id=RegionOne) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:43.456742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.458307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.468489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 453/903] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/endpoints?service_id=8613969726a34f6fa025df65da0e1e0a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:43.469590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.486116 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.502895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.543831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a9bdd-2eba-489a-941c-6b23cf28f20c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.574801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e83595-dfd7-4a5d-b078-4e39668e7554 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.581238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.582093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.582448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.582733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.592306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.593899 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:43.610084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:43.611096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:43.612207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:43.616035 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 451/904] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:43.616952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.618103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.619013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.619512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.619993 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.620918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.622617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.636540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 454/905] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:05:43.733235 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6155-a660-4a05-9a93-4ee1fedeffa1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.741566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.773114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.773802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.774087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.774368 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:43.775225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:43.775539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:43.777036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:43.804779 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 452/906] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:43.807121 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:43.912546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:43.919302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3254e48-6b38-4e77-97fa-9415d3a901d1 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:43.957838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:43.958896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:43.959397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:43.959945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.033038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.034881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595305d-7c66-49cf-9264-fed2983a76f2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.132377 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.141213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 455/907] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:05:44.146697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.250215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fc4d2-4c38-418a-a0c6-336f5936f509 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.284845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.285642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.285924 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.286200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.297041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a88a17-a511-42d8-915a-8b39ac11adad None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.297339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a88a17-a511-42d8-915a-8b39ac11adad None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.297619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a88a17-a511-42d8-915a-8b39ac11adad None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.299002 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 456/908] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:44.303929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.304285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.304604 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.304888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.305427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:44.324160 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:44.325484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:44.326686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:44.326686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:44.326686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:44.326686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:44.326686 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 453/909] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:44.332510 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.333546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:44.334848 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:44.352244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.424450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 457/910] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:44.449823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.456366 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca75b8-40fb-494a-93c1-777c13c7f41b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.492697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.493371 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.493654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.493933 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.494832 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:44.494959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.496331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.509327 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 454/911] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:44.514695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.560690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aba83-bd24-45b6-89db-763e38f5bfb0 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.588021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.596890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.599093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.603192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.603192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.603192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.603192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.603192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:44.615828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:44.616984 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:05:44.618015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:44.625652 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9df15-9e1f-480d-b17a-aaa382852527 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.625922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 458/912] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:44.628438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.657836 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.658785 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.659072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.659351 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.670395 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.671850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:44.689850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:44.690912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:44.691909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:44.696005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 455/913] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:44.696869 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.749920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a474ca-7a79-4e21-99d9-1d170978d87e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.793727 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.795329 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.795823 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.796302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.797250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:44.797769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.799390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.808510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 459/914] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:44.810975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.826726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d267f21-a6bf-4c92-9a95-56e3a73ef27e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.870995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.871877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.872283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.872648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.873659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:44.873981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.876153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551ea35-afcc-4874-bdd7-d5ff98ed364a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.878746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.879532 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:44.891290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 456/915] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:44.894335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538100-b5b1-41cd-b8ff-4ec996eed8a7 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.894335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538100-b5b1-41cd-b8ff-4ec996eed8a7 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.894335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61538100-b5b1-41cd-b8ff-4ec996eed8a7 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.895041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 457/916] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:44.902000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.902301 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.902587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.920193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:44.922448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:44.931258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27679d-f6b3-4cdf-ba83-534218d0e9c2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:44.973577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:44.974252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:44.974543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:44.974824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:44.975527 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:44.975841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:44.977234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:44.983166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 460/917] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:44.988533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:44.991850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 458/918] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:44.992818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.103882 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518c074-8782-4bb8-9b3b-3f20bdcfd940 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.105605 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9a84a-9f7f-456d-8094-fc4d01eb9abb None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.123070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:45.130031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:45.139373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.140054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.140339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.140639 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.141378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.141815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.142477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.142746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.142857 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.143033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.143995 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] RBAC: Adding query filter params (role.id=c12d21152f8e4a168ca27baf27470d90, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=d38e114f2351455bb94a6d2272b0bdd1) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:45.144313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.145975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.151827 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 461/919] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:44 2022] GET /identity/v3/role_assignments?user.id=d38e114f2351455bb94a6d2272b0bdd1&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=c12d21152f8e4a168ca27baf27470d90 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:45.152639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.232164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 459/920] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:45.276618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322214d8-a801-4808-94d2-8765a7bb1ce0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.327927 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.328893 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.329189 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.329465 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.330179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.331590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:45.345949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:45.347216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:45.348147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:45.353727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.473961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209165c6-f4cd-491f-9a51-76d7d7868b90 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.512291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.513965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.514465 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.514951 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.515875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:45.516421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.518019 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.586445 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 460/922] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:45.592039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.641694 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:45.702980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a8f33-1432-4a4a-9a86-de67011911a3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.738478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.739074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.739361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.739639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.740420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:45.740743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.742116 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204a819-ae9e-4fa8-a952-81724cc6a19a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.748219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 463/923] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:45.754208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.809110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:45.837775 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed46ec9-a364-4bb0-933b-cd396f53866f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.838452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed46ec9-a364-4bb0-933b-cd396f53866f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.838960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed46ec9-a364-4bb0-933b-cd396f53866f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.840875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 464/924] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:45.846764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.847059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.847339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.868259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:45.871674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:45.872390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5ee32-bac5-499e-89af-e57b4faeb133 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:45.918260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:45.919914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:45.920208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:45.920516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:45.921313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] RBAC: Adding query filter params (interface=public, service_id=0acf63d552a0490b9fac9f8898992751, region_id=RegionOne) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:45.921629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:45.923396 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:45.942302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 461/925] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/endpoints?service_id=0acf63d552a0490b9fac9f8898992751&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:45.944248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:45.964580 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 465/926] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:45.982778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:46.018814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:46.052074 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f81a6e-6e5b-4759-b6e9-4ce81f495d04 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:46.064742 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:46.090885 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:46.092590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:46.093138 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:46.093760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:46.094793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:46.096353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566217eb-1eb2-40f7-81a3-855d657f744a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:46.096684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:46.112614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 462/927] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:05:46.135325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:46.136166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:46.136476 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:46.136756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:46.137418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:46.139358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:46.152872 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:46.154086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:46.155452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 466/928] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:05:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:46.160622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:46.274423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f4613-dc85-45d9-a9ab-f2334384c3a3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:46.312341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:46.313443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:46.313956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:46.314487 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:46.315437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:46.315963 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:46.317626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:46.323439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 463/929] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:46.329369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:46.434039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:46.438586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2cb3a-1774-4c7d-9f93-255f4be214c0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:46.474912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:46.475985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:46.476548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:46.477108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:46.478086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:46.478631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:46.480216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bee001-cfc2-4cd9-ba83-052ae31aae3a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:46.486902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 467/930] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:46.495274 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:46.539158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:46.606088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09b604-e367-4af1-a33e-ec7129391050 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:46.642796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:46.643466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:46.643754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:46.644033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:46.644824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:46.646202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f815c7-c374-406d-9c51-1b7387301210 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:46.751507 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 464/931] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:47.249604 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a342c-441c-49ae-9d06-28f57961c2c0 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.250154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a342c-441c-49ae-9d06-28f57961c2c0 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.250154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a342c-441c-49ae-9d06-28f57961c2c0 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.251787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 468/932] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:47.257093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6bf-0ca3-457b-b53a-7f48ca333914 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.257386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6bf-0ca3-457b-b53a-7f48ca333914 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.257669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6bf-0ca3-457b-b53a-7f48ca333914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.275505 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-af55e6bf-0ca3-457b-b53a-7f48ca333914 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:47.276730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-af55e6bf-0ca3-457b-b53a-7f48ca333914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:47.354981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 465/933] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:47.377360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a342c-441c-49ae-9d06-28f57961c2c0 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:47.441059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a50a-54d7-4f43-9213-914278302b34 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.441362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a50a-54d7-4f43-9213-914278302b34 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.441640 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4a50a-54d7-4f43-9213-914278302b34 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.443140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 466/934] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:47.447946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.448256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.448562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.467708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:47.469767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:47.489425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a342c-441c-49ae-9d06-28f57961c2c0 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:47.504874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:47.532267 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:47.533504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.533859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.534211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.547459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:47.555045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 467/935] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:47.568467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:47.573186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.574196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 469/936] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:05:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:47.575019 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:47.582147 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:47.620842 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:47.701458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6ba66-21f0-4613-b7d0-d808c8a4e302 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:47.713252 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0fcf1-dcee-4565-a77c-a45ddf16acc8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:47.751596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:47.752335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.752668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.752950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.753772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:47.754086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:47.755586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:47.763731 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:47.764802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.765336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.765733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 468/937] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:05:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:47.766022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.766740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:47.768166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:47.773410 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: WARNING keystone.server.flask.common [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 23:05:47.773572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:47.786653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:47.819436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.sql.core [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:05:47.819436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 23:05:47.819436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [parameters: {'id': 'bbcac061035547b3888302285141cc3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 23:05:47.819436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=221125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcac061035547b3888302285141cc3f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcac061035547b3888302285141cc3f. Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:05:47.844245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result.read() Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 23:05:47.845217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application yield resource Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise self.value Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application session.commit() Jun 29 23:05:47.846307 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:05:47.847296 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:05:47.848284 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result.read() Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:05:47.849197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [parameters: {'id': 'bbcac061035547b3888302285141cc3f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.852070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:47.854066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbcac061035547b3888302285141cc3f. Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 470/938] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 23:05:47 2022] POST /identity/v3/projects => generated 262 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:47.856266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:47.897575 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda16a56-1496-4ba5-836d-78a8adeaef03 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:47.942390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:47.943644 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:47.944143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:47.944733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:47.956641 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:47.958466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:47.964903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:47.971896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a0585-edc2-4c82-bec2-872d04a0ff20 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:47.978259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:47.979208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:47.980193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:47.980193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:47.980193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:47.980193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:47.987823 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 469/939] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:47.989398 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.014361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.015375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.015667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.015949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.025420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.027086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:48.045091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:48.046454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:48.047430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:48.049850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 471/940] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:48.057262 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.068290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.119433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a299e-513f-4fe1-8003-6251606e6670 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.168179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.168971 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.169832 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.170178 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.170990 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:48.171337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f55808-288a-4cf5-8501-00fa07e84b70 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.171469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.172884 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.194132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 470/941] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:48.197367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.215103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.215776 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.216101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.216385 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.217347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:48.217673 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.219393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0b5d9-5eb6-42de-84f9-258c688df78f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.238388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.248477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 472/942] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:48.316150 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95016673-8677-4d6c-90d4-518f76a6588e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.335512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53d87-95fe-4209-b63f-74f51f9f2255 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.336077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53d87-95fe-4209-b63f-74f51f9f2255 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.336077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f53d87-95fe-4209-b63f-74f51f9f2255 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.337687 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 473/943] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:05:48.343994 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.344323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.344619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.350503 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.364078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.367057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.367057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.367057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.367337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:48.368008 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:48.374901 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.376732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:48.395481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:48.396643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:48.397954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 471/944] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:48.403334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.467234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 474/945] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:48.491440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.527676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea92c08-dffd-46aa-9734-f9a10aae2c29 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.578181 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.579235 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.579525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.579805 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.580781 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:48.581061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.582620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.603206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 472/946] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:48.605967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8e515-684a-4f67-b5f1-d5493a3e6ee3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.609854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.637398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.644193 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.645286 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.645793 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.646273 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.647132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.648741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.658780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:48.663009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:48.664080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:48.665130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:48.672464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 475/947] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:48.674499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.734193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c2aca-eeec-40e0-a4cc-20152df34233 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.774568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.775268 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.775559 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.775841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.787443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.788667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6eba0-73cf-4754-a80c-e3e77af30377 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.788944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:48.808232 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:48.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:48.810756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:48.810756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:48.810756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:48.810756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:48.814286 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 473/948] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:48.815265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.829586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.830581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.831028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.831475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.832495 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:48.833077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.834620 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.845638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 476/949] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:48.846833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:48.912959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.920863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:48.928069 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad2883-fd43-4d26-bc27-db2f82496670 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.960494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fd73e-1e1b-4471-9c55-3eb0b7a40f52 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:48.962439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:48.963112 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.963399 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.963682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.964429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:48.964752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:48.966679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ffea-6131-479e-a41b-1b7e11c07927 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:48.983730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 474/950] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:48.983730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e69a-0986-4bc7-829d-e1e382000a35 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:48.983730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e69a-0986-4bc7-829d-e1e382000a35 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:48.983730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e69a-0986-4bc7-829d-e1e382000a35 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:48.983730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 475/951] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:48.985050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65e69a-0986-4bc7-829d-e1e382000a35 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.003744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.004445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.004740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.005023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.005730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:49.006042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.007414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c83699-19f0-4312-b750-6ba8e6a2d301 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.012725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 477/952] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:49.012725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.012725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.012725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.033571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:49.034773 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:49.100894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65e69a-0986-4bc7-829d-e1e382000a35 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.116435 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 478/953] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:49.116435 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.146484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.147378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.147738 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.148025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.154857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.156310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:49.170605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:49.171632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:49.172662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:49.173562 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:49.176534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 476/954] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:49.177353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.193650 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:49.226572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b9d50-5eb6-4b23-8f2e-2754a5162557 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.262303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.263643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.263936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.264529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.265280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.266650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.279653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4974-a3df-42e5-952f-b4d7b8749ceb None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.314661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.315450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.315738 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.316021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] PATH_INFO: `/v3/services/compute` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.316759 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.318139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:49.330793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:49.332073 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:49.333056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 477/955] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:49.333930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.342518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 479/956] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:49.343865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.457430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:49.484797 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c3412-3b1d-49f5-a029-c802f1c848ab None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.487657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e91b2-a70e-47ae-a2b1-b0c7a7a94192 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.489322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:49.539190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.539873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.540159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.540471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.541254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] RBAC: Adding query filter params (name=compute) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:49.541569 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.542946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.545293 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.546857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.546857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.547104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.547828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:49.548221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.549883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.552710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 480/957] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:49.562944 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.565015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 478/958] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:49.572437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:49.704120 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1b63-5391-4997-9290-f00c2bf57747 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.719680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7122a-1c97-47fc-99f7-a5893c2afe36 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:49.767726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.768942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.769382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.769932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/d38e114f2351455bb94a6d2272b0bdd1/roles/c12d21152f8e4a168ca27baf27470d90` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.773527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=d38e114f2351455bb94a6d2272b0bdd1, role_id=c12d21152f8e4a168ca27baf27470d90)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.775162 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b75c5e-bbbd-4f3c-9ca9-ceb60666e98e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.777901 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:49.779254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:49.779641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:49.780388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:49.780936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] RBAC: Adding query filter params (type=compute) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:49.781736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:49.783321 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6fce5-d997-4a74-ba22-2cc89b38213c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:49.796800 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 481/959] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:49.848303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:49.854443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 479/960] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:05:49 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/d38e114f2351455bb94a6d2272b0bdd1/roles/c12d21152f8e4a168ca27baf27470d90 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:05:50.519030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0c72-ed08-42dd-bcb6-86da938876dd None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:50.519565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0c72-ed08-42dd-bcb6-86da938876dd None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:50.519565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a0c72-ed08-42dd-bcb6-86da938876dd None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:50.521254 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 482/961] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:50.526772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:50.527061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:50.527337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:50.544645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:50.545828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:50.623838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 480/962] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:50.649003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0c72-ed08-42dd-bcb6-86da938876dd None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:50.686985 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:50.760658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a0c72-ed08-42dd-bcb6-86da938876dd None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:50.795724 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:50.796338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:50.796655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:50.796934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:50.797646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:50.799077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:50.840487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.sql.core [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:05:50.840487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 23:05:50.840487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [parameters: {'user_id': 'b6eebda0d6d945bfb6c027d12d451275', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 23:05:50.840487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=221125) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result.read() Jun 29 23:05:50.848641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:05:50.849593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application yield resource Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise self.value Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application session.commit() Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:05:50.850655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:05:50.851622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:05:50.852639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application result.read() Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:05:50.853591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b6eebda0d6d945bfb6c027d12d451275', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:50.854514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 23:05:50.855368 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:50.861667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 483/963] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:05:50 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:50.862692 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:50.964539 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf71e-cc75-4283-9acd-9f4b611f4ed9 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:50.993281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:51.001861 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:51.008687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.008687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.008687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.010853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:51.012312 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-bd3ac86c-3a25-4e2d-9ef3-1770b3ee6bb7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:51.027632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:51.030175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:51.031230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 481/964] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:05:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:51.035748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:51.140572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:51.147566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25719f-b9a2-4986-b927-8eab9468e67a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:51.183200 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:51.184081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.184454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.185162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.185980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:51.186289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:51.187930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422468-e999-4577-a2e5-cfa28e52e5b1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:51.227361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 484/965] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:05:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:51.560905 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38ab2-f5a8-49d6-9536-4133fe9763bb None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.561438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38ab2-f5a8-49d6-9536-4133fe9763bb None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.561438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38ab2-f5a8-49d6-9536-4133fe9763bb None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.562881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 482/966] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:51.568211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.568652 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.568797 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.586572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:51.588080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:51.657586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 485/967] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:51.680332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38ab2-f5a8-49d6-9536-4133fe9763bb None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:51.792255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38ab2-f5a8-49d6-9536-4133fe9763bb None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:51.827227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a534e30-7892-43a3-b791-723760596008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:51.828038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534e30-7892-43a3-b791-723760596008 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.828323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534e30-7892-43a3-b791-723760596008 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.828631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a534e30-7892-43a3-b791-723760596008 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.829290 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a534e30-7892-43a3-b791-723760596008 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:51.830668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a534e30-7892-43a3-b791-723760596008 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-3a534e30-7892-43a3-b791-723760596008 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:51.842613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:51.843682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:51.844619 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:51.850429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 483/968] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:51.851646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:51.933395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:51.952278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70055759-beb7-4499-a1aa-3aafba0fea3f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:51.986913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:51.987587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:51.987874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:51.988153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:51.988907 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:51.989219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:51.990590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b483c-1280-43bb-aed7-7280172b5f2e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.000729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 486/969] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:52.001974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a534e30-7892-43a3-b791-723760596008 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.027204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a095-d309-4735-9fee-4774d0650459 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.027543 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a095-d309-4735-9fee-4774d0650459 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.027782 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a095-d309-4735-9fee-4774d0650459 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.029486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 487/970] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:52.034599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be2e-1be0-4994-a4f0-be167c9a3537 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.034888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be2e-1be0-4994-a4f0-be167c9a3537 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.035171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be2e-1be0-4994-a4f0-be167c9a3537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.053234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-05e3be2e-1be0-4994-a4f0-be167c9a3537 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:52.054425 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-05e3be2e-1be0-4994-a4f0-be167c9a3537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:52.058446 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.105577 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a534e30-7892-43a3-b791-723760596008 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.120943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 488/971] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:52.122244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab403f38-d888-4cda-9d7c-9b98a2bb7da5 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.122533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab403f38-d888-4cda-9d7c-9b98a2bb7da5 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.122809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab403f38-d888-4cda-9d7c-9b98a2bb7da5 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.124083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 489/972] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:52.129381 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.129677 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.129960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.146560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:52.146964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.147631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.147917 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.148195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.148942 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:52.149254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.150636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.154701 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:52.156095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 484/973] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:52.156914 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.223546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 490/974] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:52.224799 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.240161 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.258834 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8ef34-8b28-4c04-93c7-bca49690c985 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.274646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.292499 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.293304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.293590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.293911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.304918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:05:52.313687 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:52.314711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:52.315622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 485/975] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:52.316450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.334968 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81b57-7993-4181-af99-c1f83cde7f9f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.369420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.370014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.370300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.370581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.371371 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] RBAC: Adding query filter params (interface=admin, service_id=0acf63d552a0490b9fac9f8898992751, region_id=RegionOne) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:52.371693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.373102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.378840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 491/976] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/endpoints?service_id=0acf63d552a0490b9fac9f8898992751&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:52.379625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.417354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd03bc3-c087-4c3a-9c8d-3fa253d6b6dd None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.446880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.451434 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.452126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.452432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.452716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.453447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.454921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.477608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220a06e-eb78-4b2f-8a5f-074823f0badf None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.510837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.511487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.511769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.512043 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.513355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:52.517285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.517285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.522819 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 492/977] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:52.523667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.549552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 486/978] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:52 2022] POST /identity/v3/services => generated 242 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:05:52.550384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.608049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.635471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e4595-a2d2-41c1-93dc-30f397332f0e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.668322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:52.682227 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.682909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.683196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.683474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.684257 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.685754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.686089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df784605-8cc8-44e8-b6ee-0f5ca6b8d3d6 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.700822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 493/979] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:05:52.733888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.734711 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.734997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.735273 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.747879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.749584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:52.771195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:52.772256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:52.773292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:52.773292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:52.773292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:52.773292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:52.773292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 487/980] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:52.780740 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:52.893717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca4eac-0fdd-4d5a-9c41-0a0cdbac32db None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:52.927862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:52.928537 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:52.928826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:52.929106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:52.929825 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:52.930139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:52.931513 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:52.944700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 494/981] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:52.950701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:53.041896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:53.054401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d41fd-dd82-419d-ad99-06d2a1cf8c5a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:53.089566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:53.090383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:53.090688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:53.090970 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:53.098127 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:53.099566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:05:53.114553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:53.115611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:53.116670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 488/982] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:05:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:53.123701 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:53.179817 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:53.229469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccf64-2978-47db-8464-b6c9daf99a5c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:53.265057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:53.265730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:53.266014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:53.266289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:53.267123 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:53.267436 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:53.268929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:53.287529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 495/983] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:53.292944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:53.393860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0185b-e71a-4e4c-a84c-1abcf0920095 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:53.432314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:53.432918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:53.433205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:53.433484 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:53.453375 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:53.504092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:53.505591 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:53.607730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 489/984] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:05:53 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:05:53.609611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:53.721646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a197d-ed4e-4244-9c15-25ae2ce59c18 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:53.734464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:53.757231 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:53.758956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:53.758956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:53.758956 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:53.769742 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:53.771237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:05:53.790241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:53.791232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:53.797469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:05:53.797469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:05:53.797469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:05:53.797469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:53.797469 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 496/985] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:53.797789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:53.849098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:53.901590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007a319-8598-45f7-a5e5-1d4283cffb44 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:53.934925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:53.935582 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:53.935870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:53.936155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:53.936918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:53.937234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:53.938608 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:53.950320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 490/986] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:53.955650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.054654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce37ea-2c5f-4eb8-89d4-7dfcf4320529 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:54.087685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:54.088514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.088802 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.089081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.096293 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:54.097754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:05:54.111987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:54.112959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:05:54.113937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:54.116488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 497/987] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:54.118949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.220598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6ff62-4124-4e7b-9fdd-effd3cb801ff None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:54.229936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:54.254359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:54.255024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.255307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.255584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.256442 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:54.256760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:54.258193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109216e-0842-402f-ad02-4f2ad0a1169a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:54.276617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 491/988] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:54.278880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.303994 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:54.381441 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167a969-c0d1-4cc7-acb9-59b62d07a5b2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:54.415663 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:54.416325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.416646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.416925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.417744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] RBAC: Adding query filter params (role.id=c12d21152f8e4a168ca27baf27470d90, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=d38e114f2351455bb94a6d2272b0bdd1) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:54.418057 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:54.419525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0016719-1239-4f8a-811e-d514644491d0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:54.425712 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 498/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:05:54 2022] GET /identity/v3/role_assignments?user.id=d38e114f2351455bb94a6d2272b0bdd1&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=c12d21152f8e4a168ca27baf27470d90 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:54.652979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c7a-bd72-4631-bb61-75cf06150612 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.653365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c7a-bd72-4631-bb61-75cf06150612 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.653496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d5c7a-bd72-4631-bb61-75cf06150612 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.655038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 492/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:54.660142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94495f-f69a-4787-a090-4e6213f97dae None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.660458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94495f-f69a-4787-a090-4e6213f97dae None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.660745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94495f-f69a-4787-a090-4e6213f97dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.677353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-5d94495f-f69a-4787-a090-4e6213f97dae None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:54.678524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-5d94495f-f69a-4787-a090-4e6213f97dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:54.753361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 499/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:54.756444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bcf11-9146-4854-9e1b-89f63c36ba46 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.756444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bcf11-9146-4854-9e1b-89f63c36ba46 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.756444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54bcf11-9146-4854-9e1b-89f63c36ba46 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.756444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 493/992] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:54.761443 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.761738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.762020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.778751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:54.778954 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bcf11-9146-4854-9e1b-89f63c36ba46 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.779929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:54.791025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:54.852267 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 500/993] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:54.876624 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.898622 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54bcf11-9146-4854-9e1b-89f63c36ba46 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:54.936741 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:54.937462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:54.937747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:54.938021 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:54.938676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:54.940046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:54.952511 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:54.958694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:54.959631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 494/994] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:54.961318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:54.988090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306618e3-7b84-41d8-a0fb-3986def626e3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:54.995819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.024606 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.025412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.025886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.026027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.026598 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.028013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:55.040748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:55.041929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:55.042843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 501/995] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:05:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:55.047768 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.060675 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.073294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2b8f2-20dd-4884-8dee-3dcefb2f30a7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.109459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.110448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.110736 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.111017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.111733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:55.112051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.113457 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.123349 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 495/996] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:55.124340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.157451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28482985-01a2-409a-a3c5-1b2200f2537a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.191300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.191881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.192170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.192467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.193170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:55.193477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.194826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.199632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 502/997] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:55.205820 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.223831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.230002 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d800e2-55c6-4eb0-874f-81cdc5c70d14 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.269195 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.270175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.270457 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.270718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.271423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] RBAC: Adding query filter params (type=compute) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:55.271737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.273134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.278258 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 496/998] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:55.283862 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.286987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.313318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0b96e-684e-4ae8-94ff-048a351275e2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.348547 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.349216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.349502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.349783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.350870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:55.351213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.352615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.357645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 503/999] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:05:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:55.363027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.400487 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d42a38-667f-4f34-8ea3-86479d7b3963 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.438159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.438817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.439093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.439374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.440168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] RBAC: Adding query filter params (interface=public, service_id=e8200ef522454be7af97052c1d6d5dc2, region_id=RegionOne) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:55.440514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.441945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.447087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 497/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:05:55 2022] GET /identity/v3/endpoints?service_id=e8200ef522454be7af97052c1d6d5dc2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:55.453913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:55.472303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baa1f9-a76b-4b5a-bb02-c50ff79ee7cd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.489090 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.508938 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.509597 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.509880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.510152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.510886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.512239 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697ad9-e6cc-4257-877c-eaad02d64adb None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.564825 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b8ad5-7d21-4d32-ad1b-3381efb77083 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:55.584770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:55.593166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 504/1001] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:05:55.621183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:55.622411 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:55.622708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:55.622987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:55.623695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:55.625180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49786393-d4ca-4606-864b-81e18d30d07e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:55.640730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 498/1002] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:05:55 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:05:56.527493 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768126-95b8-4310-b117-da2546ea3e26 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:56.528640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768126-95b8-4310-b117-da2546ea3e26 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:56.528640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79768126-95b8-4310-b117-da2546ea3e26 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:56.530009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 505/1003] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:56.535311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:56.535700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:56.535879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:56.575577 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:56.576787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:56.645653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 499/1004] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:56 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:56.668122 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768126-95b8-4310-b117-da2546ea3e26 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:56.780657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79768126-95b8-4310-b117-da2546ea3e26 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:56.814270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:56.815060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:56.815343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:56.815618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] PATH_INFO: `/v3/services/image` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:56.816259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:56.817680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:56.829765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:56.830861 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:05:56.832302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 506/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:05:56 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:05:56.836837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:56.852199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:56.935750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea140f-5a04-4588-afb8-f63dd8bc165e None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:56.969377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:56.970033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:56.970318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:56.970596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:56.971302 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] RBAC: Adding query filter params (name=image) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:56.971618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:56.973022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef974e0b-f0ab-4806-899c-fcb8a896fbfe None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:56.980562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 500/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:56.984055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:57.046187 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:57.085518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c1d5-17a9-4280-b56a-a5868dc7c858 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:57.120216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:57.120915 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.121203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.121483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.122797 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] RBAC: Adding query filter params (type=image) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:57.123107 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:57.124495 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b81c52-9d62-4c32-ac2a-51f274b63a65 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:57.136512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 507/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:57.667451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f689d-ee4d-4bfa-b9b2-514db716d335 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.668032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f689d-ee4d-4bfa-b9b2-514db716d335 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.668032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f689d-ee4d-4bfa-b9b2-514db716d335 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.670094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 501/1008] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:57.675095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.675488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.675655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.691138 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbce9-6400-4661-8628-c08d475fb988 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.691423 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbce9-6400-4661-8628-c08d475fb988 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.691691 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbce9-6400-4661-8628-c08d475fb988 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.692751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:57.693058 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 502/1009] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:57.694279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:57.697870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.698161 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.698443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.718827 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:57.718827 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:57.773052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 508/1010] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:57.803325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 503/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:05:57.803534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:57.819197 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:57.830101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:57.857600 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:57.907943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e293-bd9e-447f-9202-adc0b111c69e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:57.928419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79daf9f-740d-4c2a-a5f2-67b73b9588e8 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:57.945530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:57.946326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.946609 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.946887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.948083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:57.949638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:57.951771 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 509/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:05:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:05:57.957486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:57.965208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:57.966782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:57.967254 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:57.967712 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] PATH_INFO: `/v3/services/compute` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:57.968594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:57.970032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:05:57.981783 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:05:57.982889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:05:57.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 504/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:05:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:05:57.988763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:58.062531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:58.066333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b427-66f8-40d0-b2b0-5372bbb4fd82 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:58.092876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:58.095115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4dc2f-bae5-4562-b3cc-944582dd9982 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:58.103668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:58.104335 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:58.104670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:58.104962 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:58.105684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:58.107151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:58.131756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:58.132530 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:58.132879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:58.133497 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:58.134270 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] RBAC: Adding query filter params (name=compute) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:58.134646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:58.136066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:58.141645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 505/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:58.147225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:58.202072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 510/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:57 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:05:58.252976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc00a-e02a-466c-9178-097eb1312414 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:58.290019 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:58.290716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:58.291006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:58.291291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:58.292044 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] RBAC: Adding query filter params (type=compute) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:05:58.292361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:58.293868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b357e5-308b-409a-96f8-f1655ab0db4c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:58.296376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:58.300618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 506/1016] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:05:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:05:58.305883 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:58.415515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504182cc-e990-4860-90a0-1d17b13f1901 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:58.453429 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:58.454010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:58.454290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:58.454561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:58.455308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:58.456709 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00682337-ca01-4b48-88e9-dba9812d0723 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:58.550349 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 511/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:05:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:05:59.175999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434fc4f-81d3-40fc-adfe-406ae78fd91a None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:59.176584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434fc4f-81d3-40fc-adfe-406ae78fd91a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:59.176584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434fc4f-81d3-40fc-adfe-406ae78fd91a None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:59.177989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 507/1018] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:05:59.183129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227f31-4ba4-4127-9786-000ebeda212b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:59.183575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227f31-4ba4-4127-9786-000ebeda212b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:59.183729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31227f31-4ba4-4127-9786-000ebeda212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:59.201699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-31227f31-4ba4-4127-9786-000ebeda212b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:05:59.202910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-31227f31-4ba4-4127-9786-000ebeda212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:05:59.229323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:05:59.276877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 512/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:05:59 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:05:59.300228 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434fc4f-81d3-40fc-adfe-406ae78fd91a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:05:59.409240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434fc4f-81d3-40fc-adfe-406ae78fd91a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:05:59.443835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:05:59.444455 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:05:59.444750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:05:59.445032 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:05:59.445772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:05:59.447161 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c0174-3b8c-4413-9357-2a4b2be4734a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:05:59.544424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 508/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:05:59 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:00.309864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb49d5-af90-4d12-99cb-58431b771e01 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.310423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb49d5-af90-4d12-99cb-58431b771e01 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.310423 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb49d5-af90-4d12-99cb-58431b771e01 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.311830 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 513/1021] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:00.317119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.317528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.317707 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.334269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:00.335447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:00.391680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:00.412443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 509/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:00.437953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb49d5-af90-4d12-99cb-58431b771e01 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:00.549239 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb49d5-af90-4d12-99cb-58431b771e01 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:00.583174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:00.583975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.584261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.584639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.585826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:00.587261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebf62a-3bb0-41a5-856c-226f67b5031f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:00.589081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 514/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:00.595276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:00.698269 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ac79f-2ac7-4298-b067-d829ee5039ff None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:00.720901 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11ca75-0153-49d2-a1f1-21a74ea8ea87 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.721217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11ca75-0153-49d2-a1f1-21a74ea8ea87 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.721467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11ca75-0153-49d2-a1f1-21a74ea8ea87 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.722829 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 515/1024] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:00.727929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.728226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.728556 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.742519 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:00.743439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.743883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.744329 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.745247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:00.745755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:00.746981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:00.747246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:00.768081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:00.813717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 516/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:00.838216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:00.844443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 510/1026] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:06:00 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:00.947026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5822b-a4c3-4503-8d72-98f37bc7d3b6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:00.985533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:00.986365 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:00.986651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:00.986932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:00.999379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:01.007762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:01.009103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.010445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 517/1027] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:06:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:01.016081 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.065319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.124460 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f5cf-c0ad-4f10-8506-7e7adbc79281 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.159361 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.160040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.160326 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.160635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.161392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:01.161704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.163080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.175986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 511/1028] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:01.177617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.197267 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.281972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad59b76-067e-434d-9d6a-120e1baa0ab4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.316201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.317026 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.317312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.317588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.328508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.330028 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:01.347888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:01.348945 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:01.354786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:01.354786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:01.354786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:01.354786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.354786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 518/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:01.356745 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.464353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8397f2-faa6-4b4c-b796-6c382cd9144c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.467518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.499447 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.500120 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.500429 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.500719 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.501474 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:01.501791 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.503452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b06f9-e0d3-4bdb-9d09-03dfdbea58bf None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.520240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 512/1030] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:01.521873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.592599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.595649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9291391-b7de-4dfa-92f4-d666c7565ab4 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.595941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9291391-b7de-4dfa-92f4-d666c7565ab4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.596228 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9291391-b7de-4dfa-92f4-d666c7565ab4 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.597787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 513/1031] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:06:01.605048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.605048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.605048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.621009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:01.623238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:01.632275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55e6e4-2dcd-4c62-8c04-8c37bcd0318a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.671690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.672997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.673291 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.673571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.682134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.683697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.693408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 514/1032] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:06:01.698977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:01.700063 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.701554 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 519/1033] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:01.709459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.720179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.812420 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.819122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eaf2e8-5874-4beb-a009-54c6e0363102 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.825578 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf1f5c-8beb-48e1-a414-51c704a0fc41 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:01.855276 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.855765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:01.856615 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.857049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.857329 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.858168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:01.858481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.859913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.866164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:01.867411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:01.870780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:01.870780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] PATH_INFO: `/v3/services/image` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:01.870780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:01.871664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:01.877365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 515/1034] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:01.882980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:01.885138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:01.886244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:01.887196 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:01.888018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 520/1035] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:01.894475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:01.999097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52944a02-ed17-4147-8fc4-f63cb769a49a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.004730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c02c-8ea5-4fd8-834f-c01297f68ea5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.038131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.038782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.039066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.039340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.041639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.042306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.042592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.042874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.044174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] RBAC: Adding query filter params (name=image) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:02.044518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.045886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.051013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 521/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:02.056565 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.063354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.115486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.116488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.117020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.167656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d38fb67-978f-4174-b0ec-020d3835536b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.205093 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.205786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.206071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.206344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] RBAC: Adding query filter params (type=image) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:02.207347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.209163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.214020 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 522/1037] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:02.220292 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.232285 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 516/1038] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:02.233265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.290026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.320460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f490b-660c-4216-803f-8b4df0326cd5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.339888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcf750-f96e-4a13-8bc1-e04aadf57306 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.340929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.355663 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.356348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.356667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.356998 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.357786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] RBAC: Adding query filter params (interface=public, service_id=5fccdfe334c2481bbf5173714a8d67a6, region_id=RegionOne) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:02.358101 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.359454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.365010 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 523/1039] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/endpoints?service_id=5fccdfe334c2481bbf5173714a8d67a6&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:02.370596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.382168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.383094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.383625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.383899 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.395881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.397451 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:02.415756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:02.416813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:02.417826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:02.417826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:02.417826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:02.417826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:02.417826 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 517/1040] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:02.424134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.476864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a1fd-9bd5-4e40-b4cf-5cb6b81b2ae4 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.511528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.512788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.513072 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.513347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.514025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.515400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.532442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 524/1041] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:06:02.538709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a350fa-4302-4062-b25c-57a9e85013e2 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.542795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.579096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.579841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.580126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.580488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.581253 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:02.581675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.583241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.601889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 518/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:02.603453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.659699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:02.716794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac4a0a-f18c-4dc6-8bdd-d57185d3219c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.752915 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.753714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.753992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.754263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.761313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.763317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:06:02.777485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:02.778471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:02.779445 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 525/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:02.785142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.889684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb8cf8-a35d-4936-9854-1a5000dc0d01 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:02.923649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:02.924316 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.924631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.924916 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.925716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:02.926033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:02.927471 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5cd8-e494-4d07-8f40-3d6204769b0b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:02.940432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 519/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:02.946259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:02.995022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d301b-6fed-4d7e-882c-4bfa459a7991 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:02.995309 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d301b-6fed-4d7e-882c-4bfa459a7991 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:02.995591 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d301b-6fed-4d7e-882c-4bfa459a7991 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:02.997598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 520/1045] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:06:03.002605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.002898 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.003182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.021568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:03.025242 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:03.045729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:03.059550 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f677585-329d-458e-89c0-359197b37c54 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:03.069608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:03.094062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:03.094728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.095059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.095290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.096114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] RBAC: Adding query filter params (role.id=c12d21152f8e4a168ca27baf27470d90, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:03.096453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:03.097248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 521/1046] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:03.097887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:03.108705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 526/1047] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:02 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=c12d21152f8e4a168ca27baf27470d90 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:03.122612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:03.233396 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cd64d-f15a-43fe-ae0c-080a1201f437 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:03.270638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:03.272883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.272883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.272883 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.284038 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:03.291768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:03.293094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:03.294611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 522/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:03.300359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:03.404722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f81b9-8890-4761-8085-7a6de9ee3889 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:03.438453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:03.439128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.439418 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.439698 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.440473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:03.440794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:03.442162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:03.450587 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 527/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:03.456136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:03.473443 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:03.559489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376c3a4-70f4-4768-b8b8-dd71a013ff37 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:03.594768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:03.595648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.595935 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.596213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] PATH_INFO: `/v3/users/ddf1baa491f9446aa27b37b6c17a51e0` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.610192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] RBAC: Authorizing `identity:get_user(user_id=ddf1baa491f9446aa27b37b6c17a51e0)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:03.611661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:03.613596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 523/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:03 2022] GET /identity/v3/users/ddf1baa491f9446aa27b37b6c17a51e0 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:03.619110 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:03.665013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:03.741314 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcc440-c011-4f53-8047-8b833c1d5dc3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:03.777982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:03.779490 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:03.780014 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:03.780530 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:03.849303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:03.850751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:03.883638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:03.951289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 528/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:03.956932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:04.027742 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:04.057105 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805d144-3974-4aa6-b3c7-0fdeae35b57a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:04.092012 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:04.092906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:04.093190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:04.093464 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:04.094637 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:04.096068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d79a0a-f269-4bb7-a80f-d7a209b78e21 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:04.102845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 524/1052] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:03 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:04.104085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:04.207934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802aefa-d0c4-4507-be5f-e0358c113145 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:04.244682 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:04.245347 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:04.245632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:04.245911 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:04.247264 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=168c9f93a8184b4ca134e32f98e796c2, user.id=ddf1baa491f9446aa27b37b6c17a51e0) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:04.247581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:04.249039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e7daf-96c7-46ca-9bbb-db434e0f6c1f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:04.250900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:04.264434 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 529/1053] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:04 2022] GET /identity/v3/role_assignments?user.id=ddf1baa491f9446aa27b37b6c17a51e0&scope.project.id=168c9f93a8184b4ca134e32f98e796c2&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:04.666230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65a08e-244d-4c84-a98a-6f7f078e5b35 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:04.666763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65a08e-244d-4c84-a98a-6f7f078e5b35 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:04.666848 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65a08e-244d-4c84-a98a-6f7f078e5b35 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:04.668701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 525/1054] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:04.673922 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:04.674343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:04.674533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:04.692338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:04.693560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:04.772681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 530/1055] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:04.792527 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65a08e-244d-4c84-a98a-6f7f078e5b35 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:04.896448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65a08e-244d-4c84-a98a-6f7f078e5b35 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:04.931404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:04.932123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:04.932432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:04.932723 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] PATH_INFO: `/v3/services/image` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:04.933388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:04.934822 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:04.946597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:04.947891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:04.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 526/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:06:04 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:04.953798 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.053987 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0484-ad1b-4000-93ac-748ee5a2ae3e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.079900 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.088016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.088725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.089080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.099204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.099204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] RBAC: Adding query filter params (name=image) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:05.099204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.099204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52129885-ac9a-4cdf-9912-be4c3ce91def None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:05.099204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 531/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:05.102999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.107422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.184484 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec433-75ad-4aad-8ee9-fbd49e90bbc2 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.184684 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec433-75ad-4aad-8ee9-fbd49e90bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.184972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec433-75ad-4aad-8ee9-fbd49e90bbc2 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.186617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 532/1058] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:06:05.191441 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.191730 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.192067 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.205792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d69cf-3e94-42cd-9ebd-04451952bc07 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.208527 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:05.209702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:05.242704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.243363 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.243697 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.243985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.244765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] RBAC: Adding query filter params (type=image) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:05.245075 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.246744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:05.257703 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 527/1059] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:05.259198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.281557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 533/1060] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:05.304862 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.334802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.372956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c8df9-fc75-45f0-8dd9-860624f729df None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.410928 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.411595 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.411873 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.412153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.412930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.414297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:05.414498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1540e-4e33-4aa9-a52a-8bd72fb69042 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.437454 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.448806 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.450154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.450537 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.450745 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.460708 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:05.469489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:05.470704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:05.471948 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 534/1061] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:06:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:05.476644 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.504551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 528/1062] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:06:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:05.599834 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36b82-2339-47a0-8637-046a7423d7c5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.643027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.643710 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.643998 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.644291 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.645100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:05.645374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.646767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:05.656473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 535/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:06:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:05.662382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.774495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7fb58-57c7-4071-8c45-3f785eda252c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.798707 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.810036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.810835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.811118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.811390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.822057 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.823505 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:05.841597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:05.842850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:05.844122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:05.844122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:05.844122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:05.844122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:05.846761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 529/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:05.851809 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:05.897627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:05.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657519e-8793-4166-89a1-019ae04e52b2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:05.995091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:05.995734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:05.996023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:05.996924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:05.997654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:05.997964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:05.999325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.012122 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 536/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:06.017467 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.122573 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c604762-249c-43c2-9635-bddf070700e7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.156267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.157319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.157767 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.158229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] PATH_INFO: `/v3/users/nova` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.166501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.168646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-27563cb0-5546-4a48-bf0f-26c4969ab84a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:06:06.182810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:06.184506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:06.185563 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:06.188547 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 530/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:06.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.289209 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.292863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a9cca-8d7c-4eb1-aaf7-4c6d21570260 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.298662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e179-e40d-4e00-bc32-f2ab92517a4f None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.298961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e179-e40d-4e00-bc32-f2ab92517a4f None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.299245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098e179-e40d-4e00-bc32-f2ab92517a4f None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.301850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 531/1067] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:06:06.305677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.305975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.306263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.323514 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:06.324786 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:06.330182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.330912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.331197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.331473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.332835 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:06.333154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.334915 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.353062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 537/1068] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:06.358644 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.359936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.401301 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 532/1069] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:06.425113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.463221 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32184e-6ec9-40d9-ac4b-dd8d4acaaadd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.499999 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.500838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.501129 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.501410 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.513113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.514596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.525174 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4050dbc-f76e-46cc-a4b7-32a81a82ac34 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:06.533906 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:06.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:06.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:06.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:06.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:06.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:06.536253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 538/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:06.540669 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.590494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.620214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.621154 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.621854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.622147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.633106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:06.641212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:06.642306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:06.643247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 533/1071] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:06.648821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.678347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.692763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c384b-0e79-4cde-b22e-6a466f3fc6a2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.735575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.737187 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.737691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.738136 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.739537 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:06.740021 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.741999 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.759281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 539/1072] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:06.760371 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.764159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ec3f8-4d86-44b4-a514-1ba1bb88a25d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.805960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.806570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.806835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.807123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.807874 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:06.808186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.809666 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.818092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 534/1073] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:06.825004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.842925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.874366 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd844-8302-41a3-8b28-c75180297414 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.910319 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.911238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.911529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.911812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.918720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.920510 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.921745 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:06.933311 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263179b-f217-4edd-8b09-bbc24a92287d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:06:06.935545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:06.936670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:06.937813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 540/1074] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:06.942415 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:06.974062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:06.975171 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:06.975456 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:06.975741 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] PATH_INFO: `/v3/users/ddf1baa491f9446aa27b37b6c17a51e0` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:06.976985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] RBAC: Authorizing `identity:get_user(user_id=ddf1baa491f9446aa27b37b6c17a51e0)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:06.979116 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:06.980249 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 535/1075] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/users/ddf1baa491f9446aa27b37b6c17a51e0 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:06.985689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:07.048518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c5cb6-06fa-4737-820a-a2ead9afd594 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:07.080515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:07.086570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:07.087250 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.087525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.087804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.088625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:07.089143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:07.094761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:07.094910 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3fed2-8fdc-4846-910b-1b7942e9b30f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:07.103134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 541/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:07.108813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:07.133080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:07.134490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.134961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.135492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.137554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:07.139531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:07.141691 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 536/1077] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:06 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:07.147084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:07.173562 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:07.221289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e6cc5-2d76-46a1-9c35-1d60a1e2dc62 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:07.251093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debb6b0-94f7-4638-b4ba-c9036f41a3c4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:07.255721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:07.256649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.256935 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.257216 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/c12d21152f8e4a168ca27baf27470d90` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.259788 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=fe2c18b13963439cbe1685ce9a1f9c4c, role_id=c12d21152f8e4a168ca27baf27470d90)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:07.261256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10781b-8960-4853-bc96-c56dc27284ee None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:07.285949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:07.287586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.287586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.287586 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2/users/ddf1baa491f9446aa27b37b6c17a51e0/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.289417 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] RBAC: Authorizing `identity:create_grant(project_id=168c9f93a8184b4ca134e32f98e796c2, user_id=ddf1baa491f9446aa27b37b6c17a51e0, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:07.290851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb00563-347e-4152-a212-917b2f1572ec None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:07.337662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 542/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:06:07 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/fe2c18b13963439cbe1685ce9a1f9c4c/roles/c12d21152f8e4a168ca27baf27470d90 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:06:07.367572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 537/1079] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:06:07 2022] PUT /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2/users/ddf1baa491f9446aa27b37b6c17a51e0/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:06:07.604572 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9923c-ab2e-4c1e-8d00-696320803a8f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.604790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9923c-ab2e-4c1e-8d00-696320803a8f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.605073 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9923c-ab2e-4c1e-8d00-696320803a8f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.607096 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 543/1080] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:07.612164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.612488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.612771 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.629994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:07.631172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:07.702212 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 538/1081] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:07.724977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9923c-ab2e-4c1e-8d00-696320803a8f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:07.780725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:07.833406 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9923c-ab2e-4c1e-8d00-696320803a8f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:07.869357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:07.869928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:07.870213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:07.870489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:07.938322 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:07.939781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:07.988876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:08.046458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 544/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:08.047815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:08.063616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:08.148857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4bb04-3860-4da0-84ff-8d3993f4d0c2 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:08.182925 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:08.183738 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:08.184025 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:08.184300 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:08.194256 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:08.195702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-2dbf5576-ccc2-45c2-99b1-1f1a8645e497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:08.212918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:08.213890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:08.215388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:08.215388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:08.215388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:08.215388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:08.216189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 539/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:08.220584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:08.321148 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd087f-23a8-48b5-baff-a6b239bb0438 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:08.355525 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:08.356192 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:08.356504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:08.356784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:08.357504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:08.357815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:08.359183 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764b749-01fb-4d28-a19d-ff0162434aa1 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:08.376429 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 545/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:09.395571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264cf72-e6ce-4e77-8beb-0c9d83c276bd None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.396135 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264cf72-e6ce-4e77-8beb-0c9d83c276bd None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.396135 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264cf72-e6ce-4e77-8beb-0c9d83c276bd None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.397537 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 540/1085] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:09.403355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.403759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.404042 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.421158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:09.422339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:09.425081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.433891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc617-d297-4d3a-8150-1449e2644938 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc617-d297-4d3a-8150-1449e2644938 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1bc617-d297-4d3a-8150-1449e2644938 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 541/1086] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.442886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.457625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:09.458813 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:09.489364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 546/1087] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:09.513278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.519588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.527157 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 542/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:06:09.551790 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.613003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972a277-3a2b-4955-a67f-973293aa5ae4 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.646888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:09.647621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.647903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.648176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.649782 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c49cd8-da5c-4cd8-bf1c-d775ab309493 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.656135 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.659083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:09.667345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:09.669219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:09.670515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 547/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:09.675112 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.684682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:09.685479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.685772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.686047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.696272 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:09.704050 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:09.705104 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:09.706056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 543/1090] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:09.711344 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.767068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.778076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd110e3-1f71-48e6-ad68-99f97b114865 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.809139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f75e0-f959-4551-906d-dc76207088a1 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.810937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:09.811608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.811892 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.812170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.812942 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:09.813253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:09.814610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:09.822720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 548/1091] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:09.828779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.844210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:09.844906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.845193 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.845472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.846227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:09.846535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:09.847913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:09.856181 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 544/1092] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:09.861433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:09.893283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.932491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58814-93c4-4d65-b58e-9566bf277244 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.967387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:09.967567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2517-bdd1-4db9-b616-438515deaad0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:09.968309 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:09.968720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:09.969056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:09.979753 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:09.981213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:09.985492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:09.998083 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:10.000599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:10.001614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:10.001614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:10.001614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:10.001614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:10.001614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 549/1093] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:10.003817 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.004732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.005018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.005141 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.005298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] PATH_INFO: `/v3/users/ddf1baa491f9446aa27b37b6c17a51e0` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.006491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] RBAC: Authorizing `identity:get_user(user_id=ddf1baa491f9446aa27b37b6c17a51e0)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.007926 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.015033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 545/1094] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:09 2022] GET /identity/v3/users/ddf1baa491f9446aa27b37b6c17a51e0 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:10.015972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.105761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ea460-7ceb-49a0-b4de-15c215b93eb8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.115062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a20d9-7ca8-410b-a059-73619ff1f253 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.119077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.140363 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.141049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.141335 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.141615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.142339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:10.142661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.144015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.150266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.150913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.151200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.151479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.156176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 550/1095] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:10.161923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.206177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.218815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.220278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.258033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439e233-aa08-4236-98c6-5bd716425bde None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.292259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.293105 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.293395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.293680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.300743 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.302164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:06:10.317153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:10.323226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:06:10.324978 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:10.325570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 546/1097] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:10.325676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 551/1097] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:06:10.325752 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.325826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.357571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.406297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.420981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0e5d-e33c-42ab-964c-5b34b50b694e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.423323 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f81f7-9b3d-443a-9944-f3101a07ea8c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.457152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.457943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.458230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.458333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.458509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.458919 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.459204 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.459478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.459701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.460295 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:10.460705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.461168 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.462095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.462867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 547/1098] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:10.468904 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.479477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 552/1099] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:10.485647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.567097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6945-5891-40a1-bbd4-e0bf39824957 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.576047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.584502 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b902506-e27e-43fc-948a-fc763c6e3d84 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.600277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.600960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.601246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.601528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.602353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=168c9f93a8184b4ca134e32f98e796c2, user.id=ddf1baa491f9446aa27b37b6c17a51e0) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:10.602669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.604103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.624440 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 548/1100] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/role_assignments?user.id=ddf1baa491f9446aa27b37b6c17a51e0&scope.project.id=168c9f93a8184b4ca134e32f98e796c2&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:10.624671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.624671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.624671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.624671 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.695135 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.696668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.794214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.804100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 553/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:06:10.810851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:10.830867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:10.913466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22903719-b4d7-4c7d-8274-46c759136c7b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:10.947246 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:10.948046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:10.948331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:10.948638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:10.958662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:10.960173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:10.978632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:10.979775 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:10.981929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:06:10.981929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:10.981929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:06:10.981929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:10.981929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 549/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:10.986172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:11.082674 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edebe3-665d-4f84-8ea6-374ecd95d9bc None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:11.116866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:11.117528 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:11.117807 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:11.118077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:11.118790 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:11.119094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:11.120477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:11.131988 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 554/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:11.137713 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:11.204989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:11.236095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992320c-89f3-4c3e-a266-78ac7480c794 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:11.270069 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:11.270864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:11.271153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:11.271437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:11.278657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:11.280119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:06:11.294319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:11.295403 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:11.296433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 550/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:11.301471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:11.353704 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:11.399814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeef06-d24e-418b-846e-deab1f551360 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:11.432579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:11.433234 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:11.433547 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:11.433826 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:11.434603 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:11.434914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:11.436325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66d725-9386-44f9-84b4-2dac5b4f2b01 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:11.448003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 555/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:11.454526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:11.551799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f069f9-71a1-4bf1-8b34-f4f4efc5e4e3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:11.579795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:11.585534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:11.586213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:11.595013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:11.595013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:11.595013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] RBAC: Adding query filter params (role.id=c12d21152f8e4a168ca27baf27470d90, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=fe2c18b13963439cbe1685ce9a1f9c4c) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:11.595013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:11.595013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34262d9e-874d-4ebd-a908-bd097e5f2cdc None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:11.595868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 551/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:11 2022] GET /identity/v3/role_assignments?user.id=fe2c18b13963439cbe1685ce9a1f9c4c&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=c12d21152f8e4a168ca27baf27470d90 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:06:12.686452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6495-dde8-4b83-9d44-4412aa005116 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:12.687023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6495-dde8-4b83-9d44-4412aa005116 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:12.687023 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6495-dde8-4b83-9d44-4412aa005116 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:12.688383 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 556/1107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:12.693481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:12.693872 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:12.694040 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:12.710442 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:12.711628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:12.777847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 552/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:12.802362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6495-dde8-4b83-9d44-4412aa005116 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:12.901470 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6495-dde8-4b83-9d44-4412aa005116 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:12.914645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:12.934585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:12.935372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:12.935657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:12.935935 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:12.937187 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:12.938560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37760e03-a944-4460-a521-6a8b4dd35a67 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:12.940176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 557/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:12.945950 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:13.042908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27e006-e931-4b62-aa9b-6b700db8d3ad None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:13.065430 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:13.076618 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:13.077323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:13.077648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:13.078128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:13.078965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:13.080461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d7c03-9f5b-4566-91d1-5abef1c0550c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:13.154026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 553/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:06:12 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:15.230089 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d505-3706-495b-9a7d-d931a40ccc1b None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:15.231179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d505-3706-495b-9a7d-d931a40ccc1b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:15.231179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0d505-3706-495b-9a7d-d931a40ccc1b None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:15.232536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 558/1111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:15.237656 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:15.238111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:15.238217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:15.255253 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:15.256466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:15.321384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 554/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:15.344982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0d505-3706-495b-9a7d-d931a40ccc1b None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:15.444795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0d505-3706-495b-9a7d-d931a40ccc1b None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:15.477759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:15.478611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:15.478899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:15.479181 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] PATH_INFO: `/v3/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:15.481336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] RBAC: Authorizing `identity:get_role(role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:15.482651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:15.484013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 559/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:15 2022] GET /identity/v3/roles/07aea8814ab24e5f92f880cad751bce9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:15.489720 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:15.586068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b67af2-a61b-4fef-b21f-8b5c9278db55 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:15.597220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:15.620528 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:15.621392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:15.621676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:15.621952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] PATH_INFO: `/v3/users/3108362487ee4a78a42bd8c36637c460` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:15.635560 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] RBAC: Authorizing `identity:get_user(user_id=3108362487ee4a78a42bd8c36637c460)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:15.637098 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:15.638729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 555/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:15 2022] GET /identity/v3/users/3108362487ee4a78a42bd8c36637c460 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:15.644524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:15.693085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:15.747212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d8bf-e705-48af-9e6c-e29f6cc3232e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:15.781045 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:15.782095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:15.782095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:15.782306 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:15.847482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:15.849035 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:15.894688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:15.944153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 560/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:15.950601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:16.047033 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bbba0-0690-4231-92aa-da5d3997919a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:16.079463 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:16.080304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:16.080620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:16.080891 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:16.082055 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:16.083477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e91a3-fbb8-4073-80a6-ab338d43b9a8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:16.085987 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 556/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:15 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:16.092810 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:16.190414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6572dc-a5e9-42b9-8aa3-a4c9203980f2 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:16.223515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:16.224159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:16.224474 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:16.224759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:16.225581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=168c9f93a8184b4ca134e32f98e796c2, user.id=3108362487ee4a78a42bd8c36637c460) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:16.225898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:16.227320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e8478-aac3-407a-b974-1a152e6256c4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:16.232735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 561/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:16 2022] GET /identity/v3/role_assignments?user.id=3108362487ee4a78a42bd8c36637c460&scope.project.id=168c9f93a8184b4ca134e32f98e796c2&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:18.220078 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd8a7-62ba-4b48-91f8-afb67fdbb98b None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.220665 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd8a7-62ba-4b48-91f8-afb67fdbb98b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.220665 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd8a7-62ba-4b48-91f8-afb67fdbb98b None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.222012 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 557/1118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:18.227342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.227758 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.227912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.244320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:18.245534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:18.252741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:18.314533 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 562/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:18.338153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd8a7-62ba-4b48-91f8-afb67fdbb98b None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:18.373824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:18.436802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd8a7-62ba-4b48-91f8-afb67fdbb98b None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:18.469356 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:18.470257 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.470491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.470768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] PATH_INFO: `/v3/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.472217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] RBAC: Authorizing `identity:get_role(role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:18.473613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:18.474960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 558/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:18 2022] GET /identity/v3/roles/07aea8814ab24e5f92f880cad751bce9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:18.480696 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:18.577382 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e51c5-e9f5-4d75-9f95-ae4ac9982f6a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:18.609766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:18.610627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.610916 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.611194 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] PATH_INFO: `/v3/users/3108362487ee4a78a42bd8c36637c460` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.612372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] RBAC: Authorizing `identity:get_user(user_id=3108362487ee4a78a42bd8c36637c460)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:18.613819 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:18.615428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 563/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:18 2022] GET /identity/v3/users/3108362487ee4a78a42bd8c36637c460 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:18.621551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:18.720204 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b755978-f0cb-498b-ad88-d9fade3cc0e8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:18.722598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:18.754896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:18.755749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.756034 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.756313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.757518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:18.759219 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f36ab-6189-4443-98c4-48a286382dc6 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:18.760949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 559/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:18 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:18.766853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:18.778898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:18.864003 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a918e9-b7c2-4b36-aad7-9097343fae09 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:18.897311 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:18.898191 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:18.898480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:18.898764 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2/users/3108362487ee4a78a42bd8c36637c460/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:18.900995 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] RBAC: Authorizing `identity:create_grant(project_id=168c9f93a8184b4ca134e32f98e796c2, user_id=3108362487ee4a78a42bd8c36637c460, role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:18.902452 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4854b-8071-41d6-89a3-b8b7fe4d0dec None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:18.959199 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 564/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:06:18 2022] PUT /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2/users/3108362487ee4a78a42bd8c36637c460/roles/07aea8814ab24e5f92f880cad751bce9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:06:20.961358 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb62f-414e-4ed4-8b50-45d7ec1f7346 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:20.961879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb62f-414e-4ed4-8b50-45d7ec1f7346 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:20.961879 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb62f-414e-4ed4-8b50-45d7ec1f7346 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:20.963203 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 560/1124] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:20.969370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:20.969821 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:20.969931 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:20.987514 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:20.988725 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:21.048960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:21.053409 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 565/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:21.077491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acb62f-414e-4ed4-8b50-45d7ec1f7346 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:21.175407 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acb62f-414e-4ed4-8b50-45d7ec1f7346 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:21.207768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:21.208647 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:21.208929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:21.209202 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] PATH_INFO: `/v3/roles/07aea8814ab24e5f92f880cad751bce9` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:21.210660 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] RBAC: Authorizing `identity:get_role(role_id=07aea8814ab24e5f92f880cad751bce9)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:21.212216 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:21.213535 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 561/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:21 2022] GET /identity/v3/roles/07aea8814ab24e5f92f880cad751bce9 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:21.219763 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:21.313389 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166abcf-a8f7-4e1e-b0c7-97ce1088d778 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:21.346184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:21.347040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:21.347320 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:21.347590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] PATH_INFO: `/v3/users/3108362487ee4a78a42bd8c36637c460` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:21.348814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] RBAC: Authorizing `identity:get_user(user_id=3108362487ee4a78a42bd8c36637c460)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:21.350235 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:21.351815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 566/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:21 2022] GET /identity/v3/users/3108362487ee4a78a42bd8c36637c460 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:21.357282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:21.398625 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:21.455659 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7c766-f509-4d8f-a655-509d2a1a26c5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:21.487214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:21.487788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:21.488067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:21.488341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:21.552785 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:21.554217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:21.592688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:21.649654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 562/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:21.655512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:21.719640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:21.753229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41e314-23cb-4380-acaa-fb489a1e824d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:21.785350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:21.786188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:21.786475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:21.786748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] PATH_INFO: `/v3/projects/168c9f93a8184b4ca134e32f98e796c2` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:21.787908 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] RBAC: Authorizing `identity:get_project(project_id=168c9f93a8184b4ca134e32f98e796c2)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:21.789352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169deae-85d0-4ebc-8d3e-62ffd45be9fc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:21.791064 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 567/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:21 2022] GET /identity/v3/projects/168c9f93a8184b4ca134e32f98e796c2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:21.797599 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:21.893643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4cc01-9af4-4f69-a5fb-2bfeb0806c02 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:21.926130 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:21.926764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:21.927046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:21.927319 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:21.928136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] RBAC: Adding query filter params (role.id=07aea8814ab24e5f92f880cad751bce9, scope.project.id=168c9f93a8184b4ca134e32f98e796c2, user.id=3108362487ee4a78a42bd8c36637c460) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:21.928498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:21.929927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c205ae-8792-4cb3-8fed-e385aee4697e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:21.936144 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 563/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:21 2022] GET /identity/v3/role_assignments?user.id=3108362487ee4a78a42bd8c36637c460&scope.project.id=168c9f93a8184b4ca134e32f98e796c2&role.id=07aea8814ab24e5f92f880cad751bce9 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:23.950656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fe5-bda9-46ff-82dc-9dfcf6375fb7 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:23.951212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fe5-bda9-46ff-82dc-9dfcf6375fb7 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:23.951212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b3fe5-bda9-46ff-82dc-9dfcf6375fb7 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:23.952617 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 568/1131] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:23.957959 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:23.958388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:23.958492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:23.964976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:23.975234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:23.986963 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:24.042689 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 564/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:24.065746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3fe5-bda9-46ff-82dc-9dfcf6375fb7 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:24.164508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b3fe5-bda9-46ff-82dc-9dfcf6375fb7 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:24.196610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:24.197392 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:24.197681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:24.197958 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:24.199658 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:24.201106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87994c34-9ef4-45fc-ad49-eece656bc74b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:24.202707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 569/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:24.208743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:24.305865 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf47278-947c-488b-8fba-9a5ea52d6404 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:24.338710 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:24.339894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:24.340183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:24.340490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:24.341196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:24.342640 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864d8b-8b27-4aec-88af-2ac31548bc2b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:24.345843 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:24.452314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 565/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:06:24 2022] POST /identity/v3/projects => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:26.518732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a91b7-1c22-4b15-ac53-0ffd8d073627 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:26.519312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a91b7-1c22-4b15-ac53-0ffd8d073627 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:26.519312 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a91b7-1c22-4b15-ac53-0ffd8d073627 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:26.520699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 570/1135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:26.526009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:26.526445 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:26.527134 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:26.543837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:26.545064 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:26.611431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 566/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:26.637931 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a91b7-1c22-4b15-ac53-0ffd8d073627 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:26.641748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:26.742325 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a91b7-1c22-4b15-ac53-0ffd8d073627 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:26.777324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:26.778049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:26.778331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:26.778688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:26.779929 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:26.781375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072467cb-7ed0-48ba-b0cd-669579bb3bd9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:26.782998 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 571/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:26.788867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:26.884667 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b014-9e2c-4928-bfd4-bc032c6a0bac None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:26.900820 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:26.918192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:26.918856 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:26.919143 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:26.919425 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:26.920146 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:26.921627 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675676-4617-4cb1-9356-f0e2c22cd003 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:27.010636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 567/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:06:26 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:29.064007 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53174-0494-42ec-818b-c8d252258c3d None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.064622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53174-0494-42ec-818b-c8d252258c3d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.064622 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f53174-0494-42ec-818b-c8d252258c3d None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.065870 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 572/1139] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:29.071184 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.071587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.071757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.088941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:29.090187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:29.155708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 568/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:29.179561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f53174-0494-42ec-818b-c8d252258c3d None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:29.250074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:29.278611 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f53174-0494-42ec-818b-c8d252258c3d None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:29.312499 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:29.313290 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.313570 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.313845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.323729 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:29.331507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:29.332886 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:29.334024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 573/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:29.338564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:29.436147 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f44d-0153-4ae1-b1fc-c88aeb0a62dc None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:29.437658 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:29.469111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:29.469773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.470063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.470345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.471097 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:29.471412 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:29.472898 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:29.481979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 569/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:29.487628 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:29.585140 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f1e2e-0c74-4470-ac05-674f47602c9c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:29.613504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:29.618219 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:29.619077 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.619356 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.619627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] PATH_INFO: `/v3/users/01fb577beed34ccdbb5d2dba3ece10a4` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.632477 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] RBAC: Authorizing `identity:get_user(user_id=01fb577beed34ccdbb5d2dba3ece10a4)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:29.634180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:29.635843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 574/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:29 2022] GET /identity/v3/users/01fb577beed34ccdbb5d2dba3ece10a4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:29.641708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:29.739208 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28065a-b425-4247-8cc4-86a985dd507c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:29.771701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:29.772341 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:29.772655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:29.772938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:29.803092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:29.838722 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:29.840673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:29.934799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 570/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:29.940685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:30.039167 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7bbc8-ee2e-4bc6-ad8b-c95b3165a16c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:30.071657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:30.072553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:30.072845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:30.073124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] PATH_INFO: `/v3/projects/29c3197d29e9426fb81580bd2a08ec17` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:30.074801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] RBAC: Authorizing `identity:get_project(project_id=29c3197d29e9426fb81580bd2a08ec17)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:30.076237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d95db-1e51-4410-9bc3-57a85d80aff8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:30.077975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 575/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:29 2022] GET /identity/v3/projects/29c3197d29e9426fb81580bd2a08ec17 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:30.083960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:30.144734 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:30.182292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40b5c-5057-40d7-8d9c-9802e27cc586 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:30.215798 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:30.216470 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:30.216759 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:30.217037 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:30.217865 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=29c3197d29e9426fb81580bd2a08ec17, user.id=01fb577beed34ccdbb5d2dba3ece10a4) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:30.218183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:30.219614 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bd9f3-61a0-49df-ac80-0736276c97c1 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:30.225089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 571/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:30 2022] GET /identity/v3/role_assignments?user.id=01fb577beed34ccdbb5d2dba3ece10a4&scope.project.id=29c3197d29e9426fb81580bd2a08ec17&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:32.203524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f1b03-c361-430e-936d-2101a811e19e None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.204157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f1b03-c361-430e-936d-2101a811e19e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.204157 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f1b03-c361-430e-936d-2101a811e19e None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.205479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 576/1147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:32.210695 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.211088 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.211253 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.227606 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:32.228806 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:32.293580 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 572/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:32.316389 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f1b03-c361-430e-936d-2101a811e19e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:32.374375 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:32.415483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f1b03-c361-430e-936d-2101a811e19e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:32.448551 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:32.449326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.449608 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.449882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.459746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:32.467360 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:32.468592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:32.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:32.472555 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 577/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:32.474559 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:32.530206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:32.570647 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba96307-ca0c-419d-b914-860baff6650a None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:32.603132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:32.603780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.604064 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.604343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.605653 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:32.605962 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:32.607324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:32.615043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 573/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:32.620698 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:32.718797 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474df019-26c1-40c1-85fd-9a2d7787161b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:32.735718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:32.752074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:32.752981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.753270 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.753548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] PATH_INFO: `/v3/users/01fb577beed34ccdbb5d2dba3ece10a4` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.754751 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] RBAC: Authorizing `identity:get_user(user_id=01fb577beed34ccdbb5d2dba3ece10a4)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:32.756187 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:32.757876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 578/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:32 2022] GET /identity/v3/users/01fb577beed34ccdbb5d2dba3ece10a4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:32.763897 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:32.860940 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31af70-fb0e-4941-903f-c137d2b36880 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:32.879896 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:32.895140 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:32.896000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:32.896291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:32.896603 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] PATH_INFO: `/v3/projects/29c3197d29e9426fb81580bd2a08ec17` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:32.897793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] RBAC: Authorizing `identity:get_project(project_id=29c3197d29e9426fb81580bd2a08ec17)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:32.899297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1e7f8-110b-4105-b608-8d038113a87d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:32.901016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 574/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:32 2022] GET /identity/v3/projects/29c3197d29e9426fb81580bd2a08ec17 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:32.907471 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:33.005521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fed0c-bad9-4b68-8b53-ee71412ec562 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:33.038614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:33.039485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:33.039767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:33.040043 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] PATH_INFO: `/v3/projects/29c3197d29e9426fb81580bd2a08ec17/users/01fb577beed34ccdbb5d2dba3ece10a4/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:33.041992 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] RBAC: Authorizing `identity:create_grant(project_id=29c3197d29e9426fb81580bd2a08ec17, user_id=01fb577beed34ccdbb5d2dba3ece10a4, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:33.043408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ab4df-3343-45a3-b6ee-eb3bbf4af642 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:33.130264 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 579/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:06:32 2022] PUT /identity/v3/projects/29c3197d29e9426fb81580bd2a08ec17/users/01fb577beed34ccdbb5d2dba3ece10a4/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:06:35.125106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd881a-52b8-4cdc-9446-ec4fc2eb53c0 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.125657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd881a-52b8-4cdc-9446-ec4fc2eb53c0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.125657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd881a-52b8-4cdc-9446-ec4fc2eb53c0 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.127008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 575/1154] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:35.132056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.132446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.132656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.149211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:35.150374 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:35.191750 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:35.215512 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 580/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:35.239419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd881a-52b8-4cdc-9446-ec4fc2eb53c0 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:35.337552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd881a-52b8-4cdc-9446-ec4fc2eb53c0 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:35.369903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:35.370683 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.370966 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.371241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.381036 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:35.389388 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:35.390568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:35.391693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 576/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:35.396532 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:35.492188 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d65aff-a736-48d8-b9a9-24d4011f9b53 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:35.525746 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:35.527009 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.527298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.527581 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.528393 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:35.528744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:35.530108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:35.538082 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 581/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:35.543679 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:35.593677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:35.643699 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660eec28-b111-4d73-bb4a-537f4e2efb23 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:35.675918 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:35.676797 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.677084 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.677365 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] PATH_INFO: `/v3/users/01fb577beed34ccdbb5d2dba3ece10a4` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.678554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] RBAC: Authorizing `identity:get_user(user_id=01fb577beed34ccdbb5d2dba3ece10a4)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:35.679995 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:35.681637 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 577/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:35 2022] GET /identity/v3/users/01fb577beed34ccdbb5d2dba3ece10a4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:35.687785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:35.727082 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:35.785847 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1f8c5-362a-4e99-b44a-ec09ff7d1699 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:35.818607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:35.819248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:35.819536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:35.819814 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:35.884206 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:35.886259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:35.922398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:35.981691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 582/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:35.987502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:36.083587 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc2559-57ab-4095-9058-5c0918ecfad0 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:36.099261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:36.116888 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:36.117748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:36.118067 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:36.118345 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] PATH_INFO: `/v3/projects/29c3197d29e9426fb81580bd2a08ec17` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:36.119509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] RBAC: Authorizing `identity:get_project(project_id=29c3197d29e9426fb81580bd2a08ec17)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:36.121620 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4b85b-a721-4884-b14e-1677287745a7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:36.123343 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 578/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:35 2022] GET /identity/v3/projects/29c3197d29e9426fb81580bd2a08ec17 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:36.129419 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:36.227090 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a520-a0dd-433b-81cc-f4db95fb8e7b None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:36.261821 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:36.262473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:36.262759 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:36.263038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:36.263856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=29c3197d29e9426fb81580bd2a08ec17, user.id=01fb577beed34ccdbb5d2dba3ece10a4) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:36.264171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:36.265715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adbfb6-57b4-4a63-a91b-04c25f33e5e9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:36.271421 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 583/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:36 2022] GET /identity/v3/role_assignments?user.id=01fb577beed34ccdbb5d2dba3ece10a4&scope.project.id=29c3197d29e9426fb81580bd2a08ec17&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:38.318298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be287c-0ca7-4d7d-9d2e-fab7c1e89fec None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:38.318860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be287c-0ca7-4d7d-9d2e-fab7c1e89fec None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:38.318860 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be287c-0ca7-4d7d-9d2e-fab7c1e89fec None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:38.320206 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 579/1162] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:38.325871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:38.326288 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:38.326438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:38.331457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:38.343737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:38.348584 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:38.413030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 584/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:38.435863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be287c-0ca7-4d7d-9d2e-fab7c1e89fec None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:38.534266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be287c-0ca7-4d7d-9d2e-fab7c1e89fec None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:38.567176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:38.567804 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:38.568087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:38.568441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:38.617953 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:38.632701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:38.634408 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:38.732765 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 580/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:38.738582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:38.833662 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad8b8a-ad7a-4df1-bf05-e269d4f2d8af None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:38.862178 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:38.866932 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:38.867719 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:38.868000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:38.868358 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:38.874928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:38.876354 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-a7f46b2e-79ab-4d06-87e8-deda5ded1718 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:38.891098 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:38.892473 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:38.893678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 585/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:06:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:38.898066 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:38.979787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:38.994867 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a322bb-d78c-46c0-a2c7-71812b646b3f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:39.028919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:39.029564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:39.029851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:39.030131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:39.030855 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:39.031167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:39.032569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677dbb2-d293-4eb3-9019-33cf6cddef54 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:39.039578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 581/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:06:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:41.071722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d65493-f5ff-4d56-a177-38ad2411db60 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:41.072238 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d65493-f5ff-4d56-a177-38ad2411db60 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:41.072364 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d65493-f5ff-4d56-a177-38ad2411db60 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:41.074327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 586/1167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:41.079486 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464754-19ff-4301-9fd7-d7ca2594bd34 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:41.079887 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464754-19ff-4301-9fd7-d7ca2594bd34 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:41.080048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464754-19ff-4301-9fd7-d7ca2594bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:41.096550 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-34464754-19ff-4301-9fd7-d7ca2594bd34 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:41.097724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-34464754-19ff-4301-9fd7-d7ca2594bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:41.162493 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 582/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:41.186025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d65493-f5ff-4d56-a177-38ad2411db60 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:41.286964 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d65493-f5ff-4d56-a177-38ad2411db60 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:41.320183 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:41.320850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:41.321133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:41.321408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:41.322184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:41.323519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297e3ca1-8e4f-45e4-8c16-fd38d59ab4f8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:41.403670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 587/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Jun 29 23:06:41 2022] POST /identity/v3/domains => generated 267 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:43.472688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0f39-d794-414c-8e09-d3078a6016ce None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:43.473229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0f39-d794-414c-8e09-d3078a6016ce None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:43.473359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0f39-d794-414c-8e09-d3078a6016ce None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:43.474630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 583/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:43.480548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:43.480950 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:43.481106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:43.497439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:43.498623 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:43.545170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:43.563937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 588/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:43.587829 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0f39-d794-414c-8e09-d3078a6016ce None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:43.664263 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:43.685727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0f39-d794-414c-8e09-d3078a6016ce None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:43.720095 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:43.720992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:43.721282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:43.721566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] PATH_INFO: `/v3/domains/5ced15b0b5784b8c976c6304992109e5` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:43.731976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ced15b0b5784b8c976c6304992109e5)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:43.733406 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acae89-e4d0-430e-af8c-db118a64d4ac None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:43.735048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 584/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 23:06:43 2022] GET /identity/v3/domains/5ced15b0b5784b8c976c6304992109e5 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:43.740869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:43.836522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a70778-bc0d-42d9-842c-c74262974aa5 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:43.870001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:43.870650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:43.870940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:43.871225 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:43.871936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:43.873633 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e03e0f-3b9f-4e86-8c30-2b7cd2009e83 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:43.980707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 589/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:06:43 2022] POST /identity/v3/projects => generated 361 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:46.044441 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736cf08-2975-46e9-9331-fb917e6cc7ab None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:46.045016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736cf08-2975-46e9-9331-fb917e6cc7ab None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:46.045016 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736cf08-2975-46e9-9331-fb917e6cc7ab None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:46.046275 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 585/1174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:46.051486 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:46.051918 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:46.052104 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:46.069574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:46.070741 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:46.096783 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:46.137295 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 590/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:46.163233 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736cf08-2975-46e9-9331-fb917e6cc7ab None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:46.262973 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736cf08-2975-46e9-9331-fb917e6cc7ab None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:46.297247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:46.298045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:46.298332 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:46.298611 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] PATH_INFO: `/v3/domains/5ced15b0b5784b8c976c6304992109e5` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:46.299824 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=5ced15b0b5784b8c976c6304992109e5)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:46.301299 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012379a-f0d8-463d-97e5-b3b1a32694ee None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:46.302907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 586/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 23:06:46 2022] GET /identity/v3/domains/5ced15b0b5784b8c976c6304992109e5 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:46.308575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:46.408226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99a4f3-df5b-4237-b5a8-49c0b04ba53c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:46.441488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:46.442151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:46.442440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:46.442722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:46.443440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:46.444901 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241bfdb-41be-4dd8-8b66-2d8fcb4b9544 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:46.528755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 591/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:06:46 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:06:48.573916 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed165f-201e-43fd-97bb-8b9d55c1dde3 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:48.574481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed165f-201e-43fd-97bb-8b9d55c1dde3 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:48.574481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed165f-201e-43fd-97bb-8b9d55c1dde3 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:48.575819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 587/1178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:48.581103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:48.581516 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:48.581665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:48.598632 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:48.599812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:48.614088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:48.664871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 592/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:48.689061 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed165f-201e-43fd-97bb-8b9d55c1dde3 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:48.697871 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:48.789868 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed165f-201e-43fd-97bb-8b9d55c1dde3 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:48.821634 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:48.822903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:48.823185 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:48.823459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:48.833306 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:48.841453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:48.842761 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:48.843875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 588/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:48.848665 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:48.946509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c3bd0c-53e0-42a4-8220-f0c7cfeaa2b3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:48.985456 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:48.986114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:48.986400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:48.986680 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:48.987422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:48.987735 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:48.989131 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:48.997046 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 593/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:49.002805 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:49.067459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:49.101684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b89f9b-4969-4164-b1a3-e75427969821 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:49.135616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:49.136503 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:49.136794 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:49.137079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] PATH_INFO: `/v3/users/de8b3e1291ae4d3fa086df09fa5b0485` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:49.149847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] RBAC: Authorizing `identity:get_user(user_id=de8b3e1291ae4d3fa086df09fa5b0485)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:49.151335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:49.152999 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 589/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:49 2022] GET /identity/v3/users/de8b3e1291ae4d3fa086df09fa5b0485 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:49.158714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:49.173579 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:49.256986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb42a3-d890-40b3-b48e-6036299d5ec5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:49.290190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:49.290833 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:49.291118 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:49.291394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:49.355925 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:49.357333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:49.371397 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:49.454387 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 594/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:49.460298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:49.556415 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192493b0-9bef-4138-a5da-0529e878762e None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:49.579714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:49.590156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:49.591020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:49.591310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:49.591591 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] PATH_INFO: `/v3/projects/bcd038611ccc430db6e4626bdfc30dd7` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:49.592805 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] RBAC: Authorizing `identity:get_project(project_id=bcd038611ccc430db6e4626bdfc30dd7)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:49.594241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b43806-8b27-42b5-9e46-09d59881019e None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:49.595936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 590/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:49 2022] GET /identity/v3/projects/bcd038611ccc430db6e4626bdfc30dd7 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:49.602259 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:49.699519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc0ec-4fdb-4e62-9b87-983a3d65687d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:49.711781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:49.733006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:49.735596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:49.735596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:49.735596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:49.735596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=bcd038611ccc430db6e4626bdfc30dd7, user.id=de8b3e1291ae4d3fa086df09fa5b0485) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:49.735596 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:49.736898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bf951-14a3-4b94-964c-722ecad135ed None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:49.742353 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 595/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:49 2022] GET /identity/v3/role_assignments?user.id=de8b3e1291ae4d3fa086df09fa5b0485&scope.project.id=bcd038611ccc430db6e4626bdfc30dd7&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:51.750815 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7953-cacf-4394-b22c-6b10ae8916de None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:51.751339 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7953-cacf-4394-b22c-6b10ae8916de None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:51.751449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a7953-cacf-4394-b22c-6b10ae8916de None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:51.752760 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 591/1186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:51.758317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:51.758738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:51.758864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:51.776491 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:51.777664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:51.841478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 596/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:51.863907 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7953-cacf-4394-b22c-6b10ae8916de None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:51.961593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a7953-cacf-4394-b22c-6b10ae8916de None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:51.993952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:51.994728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:51.995010 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:51.995282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:52.005027 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:52.013380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:52.014555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:06:52.015542 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 592/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:52.020328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:52.115561 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7b28e-5c12-4248-84c3-e68810d0ef8d None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:52.123174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:52.149213 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:52.149868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:52.150150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:52.150451 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:52.151190 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:52.151498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:52.152890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:52.160659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 597/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:52.166196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:52.217812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:52.264732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e812d9-c250-4feb-8aa0-5acb682db9af None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:52.296654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:52.297501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:52.297781 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:52.298056 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] PATH_INFO: `/v3/users/de8b3e1291ae4d3fa086df09fa5b0485` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:52.299224 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] RBAC: Authorizing `identity:get_user(user_id=de8b3e1291ae4d3fa086df09fa5b0485)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:52.300676 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:52.302260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 593/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:52 2022] GET /identity/v3/users/de8b3e1291ae4d3fa086df09fa5b0485 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:52.308308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:52.404626 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b14207-1552-401f-a8d4-3ca4b30185f7 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:52.436961 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:52.437804 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:52.438084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:52.438378 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] PATH_INFO: `/v3/projects/bcd038611ccc430db6e4626bdfc30dd7` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:52.439542 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcd038611ccc430db6e4626bdfc30dd7)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:52.440983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e0f69-a7dc-41e8-a115-61603fc7f0a4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:52.442649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 598/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:52 2022] GET /identity/v3/projects/bcd038611ccc430db6e4626bdfc30dd7 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:52.449022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:52.547322 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff8cf-6fe7-4cb5-9734-f328575f943a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:52.566488 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:52.579694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:52.580596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:52.580877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:52.581152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] PATH_INFO: `/v3/projects/bcd038611ccc430db6e4626bdfc30dd7/users/de8b3e1291ae4d3fa086df09fa5b0485/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:52.583082 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcd038611ccc430db6e4626bdfc30dd7, user_id=de8b3e1291ae4d3fa086df09fa5b0485, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:52.584545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef453c84-094f-41ad-a302-07073b501541 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:52.653469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 594/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:06:52 2022] PUT /identity/v3/projects/bcd038611ccc430db6e4626bdfc30dd7/users/de8b3e1291ae4d3fa086df09fa5b0485/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:06:54.641220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480120fa-d243-47be-9e54-37b302e1ad1a None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:54.641781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480120fa-d243-47be-9e54-37b302e1ad1a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:54.641781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480120fa-d243-47be-9e54-37b302e1ad1a None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:54.643275 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 599/1193] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:06:54.648678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:54.649106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:54.649244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:54.666841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:06:54.668026 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:06:54.733216 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 595/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:06:54.757171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480120fa-d243-47be-9e54-37b302e1ad1a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:54.795895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:54.859699 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480120fa-d243-47be-9e54-37b302e1ad1a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:54.893350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:54.894081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:54.894366 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:54.894643 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:54.905091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:06:54.912770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:06:54.913949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:06:54.915059 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 600/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:06:54.919949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:55.016383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf341f0f-9ab1-439d-9f93-d65765bc3648 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:55.027198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:55.049558 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:55.050222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:55.050509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:55.050789 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:55.051545 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:55.051858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:55.053310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:55.061733 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 596/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:55.068012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:55.160778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:55.166413 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d18a2-e506-4fe6-864d-9ec9905ee0fc None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:55.200155 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:55.201050 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:55.201338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:55.201618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] PATH_INFO: `/v3/users/de8b3e1291ae4d3fa086df09fa5b0485` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:55.202792 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=de8b3e1291ae4d3fa086df09fa5b0485)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:55.204256 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:55.205910 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 601/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:06:55 2022] GET /identity/v3/users/de8b3e1291ae4d3fa086df09fa5b0485 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:55.211561 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:55.307997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b8b96-b471-430b-843a-e804897fea19 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:55.339997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:55.340652 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:55.340936 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:55.341214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:55.379894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:55.405930 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:55.407362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:55.502401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:06:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:06:55.508676 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:55.605914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1cd68-47f0-46b6-b08b-acd806b4c6b0 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:55.639156 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:55.640000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:55.640285 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:55.640588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] PATH_INFO: `/v3/projects/bcd038611ccc430db6e4626bdfc30dd7` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:55.641757 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] RBAC: Authorizing `identity:get_project(project_id=bcd038611ccc430db6e4626bdfc30dd7)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:55.643176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead344a-df78-4f99-a4cb-5e7581fd5f5c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:55.644882 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 602/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:06:55 2022] GET /identity/v3/projects/bcd038611ccc430db6e4626bdfc30dd7 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:06:55.650873 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:06:55.717612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:06:55.746732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b68043-b803-402d-ae0b-7f9d2990370b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:06:55.779260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:06:55.779841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:06:55.780125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:06:55.780419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:06:55.781251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=bcd038611ccc430db6e4626bdfc30dd7, user.id=de8b3e1291ae4d3fa086df09fa5b0485) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:06:55.781564 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:06:55.782993 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8ce5d-6406-4cf5-bffa-ecdcd14eba2d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:06:55.788684 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 598/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:06:55 2022] GET /identity/v3/role_assignments?user.id=de8b3e1291ae4d3fa086df09fa5b0485&scope.project.id=bcd038611ccc430db6e4626bdfc30dd7&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:07:05.635022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=84 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:07:05.786047 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=32 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:11.005752 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff73e3-8765-450b-be8f-52e5fdb7886c None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:11.006318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff73e3-8765-450b-be8f-52e5fdb7886c None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:11.006318 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff73e3-8765-450b-be8f-52e5fdb7886c None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:11.008006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 603/1201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:11.013291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:11.013699 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:11.013857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:11.030909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:11.032093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:11.097876 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 599/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:11.123614 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff73e3-8765-450b-be8f-52e5fdb7886c None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:11.223969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aff73e3-8765-450b-be8f-52e5fdb7886c None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:11.257030 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:11.258013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:11.258294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:11.258566 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:11.269078 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:11.270511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:11.288449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:11.289859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:11.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:11.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:11.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:11.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:11.291214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 604/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:11.295723 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:11.392881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad051947-c61b-4401-a1a5-3b14b81ff5c1 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:11.421262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:11.427099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:11.428113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:11.428113 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:11.428367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:11.429122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:11.429459 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:11.430847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b0634f-ecd9-44f2-b77c-3c95dee388f0 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:11.441893 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 600/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:11.447534 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:11.501016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:11.546756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6e4f5-8194-48b1-8622-61de73e03991 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:11.587521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:11.588179 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:11.588524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:11.588808 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:11.589515 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:11.591015 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579104a6-f176-4106-82cf-03b52a133379 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:11.682789 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 605/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:08:11 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:08:13.731931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2fbdb-2b98-4ec7-acee-38f0a1b5c472 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:13.732744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2fbdb-2b98-4ec7-acee-38f0a1b5c472 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:13.732744 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2fbdb-2b98-4ec7-acee-38f0a1b5c472 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:13.733996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 601/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:13.739370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:13.739784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:13.739946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:13.757379 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:13.758838 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:13.827119 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 606/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:13.850858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2fbdb-2b98-4ec7-acee-38f0a1b5c472 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:13.952133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2fbdb-2b98-4ec7-acee-38f0a1b5c472 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:13.984702 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:13.985432 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:13.985709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:13.985976 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:13.996377 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:14.004125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:14.005422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:14.006772 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 602/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:14.012201 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.050287 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:14.107666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174d2e0-72dc-4d7e-b611-b8ccb619f16e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.142153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.142816 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.143106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.143372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.144134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:14.144463 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:14.145829 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:14.153737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 607/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:14.159496 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.209982 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:14.259283 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d345b-b075-4a49-9c95-f628aaa14556 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.292590 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.293410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.293688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.293963 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.304214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:14.305774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:14.323110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:14.324096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:14.325192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:14.325192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:14.325192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:14.325192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:14.325192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 603/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:14.330153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.425784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:14.428681 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c58d0-4cc2-4e12-badd-db5c13cf7e40 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.461412 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.462112 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.462394 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.462666 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.463398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:14.463705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:14.465078 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:14.476029 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 608/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:14.482245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.581977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b91b-a0ab-4412-a7df-3969c9f1d885 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.583512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:14.616657 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.617450 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.617737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.618020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.624919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:14.630721 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:14.641247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:14.642335 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:14.643402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 604/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:14.648508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.758027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f481b8a-b0fa-42d0-806d-487a757c42b5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.797963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.798645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.798934 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.799214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.800054 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:14.800370 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:14.801867 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:14.819367 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 609/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:14.825130 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:14.932838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5856d1-9600-485c-a406-5abc08938a11 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:14.967119 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:14.967768 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:14.968048 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:14.968323 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:14.997928 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.036648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.038107 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.136295 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 605/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:08:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:08:15.140348 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:15.159787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.238722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abbe5a-d832-4f33-8e89-a743199e5005 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:15.273912 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:15.274697 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:15.275018 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:15.275287 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:15.285563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.286995 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:15.304099 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:15.305248 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:15.306279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:15.306279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:15.306279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:15.306279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:15.306279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 610/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:15.311642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:15.370766 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.409267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a38d5-f447-4e52-a300-1ddb3a85c5f7 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:15.442340 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:15.442997 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:15.443282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:15.443560 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:15.444281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:15.444646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.446046 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.458376 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 606/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:15.464430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:15.533641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.563212 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992aad1-d749-4340-828f-d0b9b28cfc62 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:15.597333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:15.600237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:15.600237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:15.600237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:15.605203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.606638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:15.620640 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:15.621634 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:15.622627 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 611/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:15.627616 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:15.729504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc25d-39d2-491f-bf30-b5c4db6670a5 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:15.754435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.766320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.772244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3208f9-82e8-49a1-8771-18a66e255d5f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.781708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 607/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:15.787920 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:15.886858 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5843b46-e459-4c98-9b0a-fa178378c422 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:15.913943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:15.920266 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:15.920981 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:15.921299 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:15.921582 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:15.922404 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=f830d079afc149b392bff5fb9a76c9f5) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:15.922722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:15.924151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4016d-c142-4fd7-8a91-5de69d4b0e4e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:15.929685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 612/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:08:15 2022] GET /identity/v3/role_assignments?user.id=f830d079afc149b392bff5fb9a76c9f5&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:17.965778 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b731512-284e-4094-8d11-b7eda687808c None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:17.966351 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b731512-284e-4094-8d11-b7eda687808c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:17.966351 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b731512-284e-4094-8d11-b7eda687808c None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:17.967701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 608/1220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:17.973143 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:17.973575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:17.973714 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:17.990930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:17.992100 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:18.059865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:18.082715 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b731512-284e-4094-8d11-b7eda687808c None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.183725 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b731512-284e-4094-8d11-b7eda687808c None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:18.216205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:18.217080 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:18.217384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:18.217668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:18.228126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:18.236642 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:18.237764 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:18.239179 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 609/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:18.244086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.344313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be3910-e137-4bd9-94e8-9cd69a73f2b0 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:18.369349 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:18.380267 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:18.380972 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:18.381258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:18.381536 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:18.382297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] RBAC: Adding query filter params (name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:18.382854 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:18.384202 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:18.391958 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 614/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:18.397828 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.442210 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:18.496714 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7df0ed-bc81-4daa-b914-9d2b4d3ef5c3 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:18.531531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:18.532318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:18.532631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:18.532911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:18.543494 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:18.544974 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:18.562125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:18.563255 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:18.564288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:18.564288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:18.564288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:18.564288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:18.564288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 610/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:18.569442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.669811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d05f-97b5-431f-b14b-58c536b2c620 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:18.702989 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:18.704121 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:18.704433 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:18.704705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:18.705424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:18.705736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:18.707164 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:18.719967 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 615/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:18.725927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.818231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:18.825570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b83e-d1d5-45b7-8bea-5d38b3bb6d66 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:18.858846 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:18.859649 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:18.859938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:18.860217 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:18.867213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:18.868688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:18.883945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:18.885694 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:18.886808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 611/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:18.891629 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:18.938346 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:18.991481 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa1cad-02e1-4ff6-9729-1485c168053c None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.025398 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.026094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.026378 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.026655 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.027472 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:19.027780 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.029209 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.045700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 616/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:19.051570 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:19.150043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92364c-8530-45fc-acd3-e754f9b93d0d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.184515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.185310 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.185597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.185877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.201284 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.202774 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:19.220158 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:19.221229 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:19.222221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:19.222221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:19.222221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:19.222221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:19.222221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 612/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:19.227232 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:19.327038 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188684e-d6b9-4518-a1cc-3bda64f6198d None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.329450 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:19.359880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.360588 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.360879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.361162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.361914 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:19.362228 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.363628 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.375327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 617/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:19.381281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:19.391133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:19.481518 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ab964-b6d4-4dff-84c6-11e56991048b None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.514908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.515700 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.515989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.516270 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.523011 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.524497 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:19.538748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:19.539803 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:19.540863 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 613/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:19.546448 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:19.648361 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2cb2d-e487-49c4-ab44-03dd2b0843ca None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.682538 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.683197 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.683479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.683779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.684585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:19.684898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.686386 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12f44c-62cb-414e-a24b-e54e845d0f24 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.698339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 618/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:19.704771 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:19.772384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:19.808378 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0607-43bc-411b-888a-df22e6133109 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:19.841755 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:19.842638 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] REQUEST_METHOD: `PUT` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:19.842921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:19.843198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/f830d079afc149b392bff5fb9a76c9f5/roles/7d0253ef6ce84a7391264e3b3d7662f2` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:19.858103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=f830d079afc149b392bff5fb9a76c9f5, role_id=7d0253ef6ce84a7391264e3b3d7662f2)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:19.859546 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef66f22-9fbd-4b2c-ba56-8aa5e14a1830 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:19.927643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:08:19 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/f830d079afc149b392bff5fb9a76c9f5/roles/7d0253ef6ce84a7391264e3b3d7662f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:08:21.950949 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5291ec-048a-421d-91e4-d4e7831a5460 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:21.951553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5291ec-048a-421d-91e4-d4e7831a5460 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:21.951553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5291ec-048a-421d-91e4-d4e7831a5460 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:21.952896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 619/1233] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:21.958502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:21.958502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:21.959013 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:21.975727 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:21.976938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:22.042757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 615/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:22.066645 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5291ec-048a-421d-91e4-d4e7831a5460 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.091902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:22.164965 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5291ec-048a-421d-91e4-d4e7831a5460 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:22.199217 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:22.200000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:22.200283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:22.200585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:22.210668 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:22.218651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:22.225464 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:22.226395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 620/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:22.228579 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.274386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:22.328155 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760aaa7-99c3-41e2-8a19-c0a658c9cf04 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:22.360173 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:22.360889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:22.361138 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:22.361416 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:22.362164 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] RBAC: Adding query filter params (name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:22.362473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:22.363845 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:22.372475 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 616/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:22.377887 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.461813 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:22.477165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237b98c-d517-497f-8217-4433eb0948b5 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:22.510794 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:22.511568 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:22.511853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:22.512130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:22.521986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:22.523437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:22.542109 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:22.543195 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:22.544166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:22.544166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:22.544166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:22.544166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:22.544166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 621/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:22.549404 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.649298 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529091d-4e34-4048-a41c-be15d014b090 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:22.658005 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:22.682912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:22.683566 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:22.683851 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:22.684128 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:22.684887 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:22.685197 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:22.686571 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:22.697858 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 617/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:22.703660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.807603 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f10e-06e9-41a7-bc7e-d9c4c20dc3f9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:22.838980 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:22.839803 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:22.840080 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:22.840352 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:22.843186 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:22.847840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:22.849336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:22.864459 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:22.866236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:22.867563 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 622/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:22.872133 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:22.972763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870ce2-7c8e-4fde-b60f-f1a1cb11b9d9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.006014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.006675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.006956 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.007231 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.008331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:23.008669 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.010167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.028142 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 618/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:23.033879 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:23.131651 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d792ba-6ead-4e49-92fe-ba29e813ef51 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.165943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.166583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.166909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.167200 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.227420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:23.234508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.236132 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.331443 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:08:23.337314 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:23.365132 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:23.439226 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d88874-2a99-4bfa-9964-88eb916ae63c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.468126 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.468937 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.469225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.469502 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.479145 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.480609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:23.499763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:23.500972 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:23.501984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:23.501984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:23.501984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:23.501984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:23.501984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 619/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:23.506779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:23.599390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:23.605022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631bfd3-72d8-4cad-86f0-1b3da46f9a2e None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.638455 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.639107 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.639390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.639664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.640372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:23.640706 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.642052 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.652913 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 624/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:23.658838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:23.737674 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:23.759728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758504c-3c8b-44c0-bfca-770b641cbb66 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.793512 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.794305 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.794592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.794913 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.801462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.802906 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:23.817096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:23.818289 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:23.819380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 620/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:23.824951 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:23.926006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10057a6c-d58b-49b0-817e-daa86492bb49 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:23.958924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:23.959613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:23.959899 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:23.960174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:23.960986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:23.961298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:23.962723 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a073ae-de51-4068-aaa6-335d0317b82e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:23.974868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 625/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:23.981491 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:24.081248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ad7eb-fa60-4ebd-81e6-54a499076cff None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:24.114584 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:24.115244 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:24.115533 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:24.115808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:24.116678 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] RBAC: Adding query filter params (role.id=7d0253ef6ce84a7391264e3b3d7662f2, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=f830d079afc149b392bff5fb9a76c9f5) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:24.116994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:24.118444 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5668c-83a6-442d-85f7-c4ab22c34e2f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:24.135494 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 621/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:08:23 2022] GET /identity/v3/role_assignments?user.id=f830d079afc149b392bff5fb9a76c9f5&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=7d0253ef6ce84a7391264e3b3d7662f2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:26.253086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9f57-1653-4ef5-a534-51355a4b9ac5 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:26.253654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9f57-1653-4ef5-a534-51355a4b9ac5 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:26.253654 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb9f57-1653-4ef5-a534-51355a4b9ac5 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:26.255061 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 626/1247] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:08:26.260568 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbd55-be13-4571-9333-6b516659e184 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:26.261015 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbd55-be13-4571-9333-6b516659e184 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:26.261123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbd55-be13-4571-9333-6b516659e184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:26.266362 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:26.278402 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-300fbd55-be13-4571-9333-6b516659e184 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:26.279596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-300fbd55-be13-4571-9333-6b516659e184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:26.346531 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:26.371589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9f57-1653-4ef5-a534-51355a4b9ac5 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:26.390031 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:26.473607 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb9f57-1653-4ef5-a534-51355a4b9ac5 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:26.508986 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:26.509744 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:26.510036 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:26.510315 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:26.520441 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:26.528784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:26.529930 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:26.530866 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 627/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:26.536191 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbd55-be13-4571-9333-6b516659e184 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:26.642141 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbd55-be13-4571-9333-6b516659e184 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:26.673198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:26.678238 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:26.678929 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:26.679214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:26.679495 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:26.680249 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:26.680597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:26.682043 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:26.690227 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 623/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:26.695877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:26.776995 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:26.800424 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f54c1-0eeb-4f1b-a691-c9abad374759 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:26.834081 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:26.835013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:26.835545 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:26.835983 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:26.847795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:26.849247 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:26.866839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:26.868058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:26.869331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:26.869331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:26.869331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:26.869331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:26.869331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 628/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:26.873844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:26.977991 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b404519-f53b-43c5-b5c8-fb6bfc9537a4 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:27.015199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:27.018108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:27.018108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:27.018108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:27.018108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:27.018108 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:27.018897 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:27.031353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 624/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:27.036953 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:27.138070 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a952d-e8df-4ed5-b872-a10f874578dd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:27.164334 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:27.172053 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:27.173509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:27.173509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:27.173509 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] PATH_INFO: `/v3/users/placement` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:27.180960 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:27.182408 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:27.196679 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:27.198440 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:27.199732 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:27.200691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 629/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:27.208094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:27.260902 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:27.305086 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24257fc4-ddfe-42f4-bf89-c0662fbec638 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:27.340538 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:27.341215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:27.341504 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:27.341787 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:27.342626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:27.342944 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:27.344419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:27.361835 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 625/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:27.367540 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:27.468149 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222b0a5-f5d9-425d-a4bb-b8ce0c3f3ebd None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:27.501623 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:27.502271 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:27.502557 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:27.502836 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:27.562298 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:27.576485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:27.578022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:27.688837 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:08:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:08:27.694506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:27.796724 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b684cf-0ea6-47fe-809c-0e248e5e46e8 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:27.810392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:27.830743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:27.831536 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:27.831823 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:27.832101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:27.842190 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:27.843635 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:27.861248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:27.862594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:27.863981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:27.863981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:27.863981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:27.863981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:27.863981 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 626/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:27.868154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:27.955868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:27.967519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800d509-5be4-4ff6-b92e-3f1b9d23931f None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:28.001055 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:28.001718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:28.002000 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:28.002272 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:28.003025 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:28.003332 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:28.004720 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:28.016075 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 631/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:28.021810 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:28.120952 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93aefee-1bc5-46aa-8b24-1085fde529ef None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:28.154099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:28.154875 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:28.155162 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:28.155435 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:28.161947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:28.163387 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:28.177931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:28.179062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:28.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 627/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:28.185276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:28.283237 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc7946-7004-4c3f-89b2-3cbd8d726b81 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:28.316526 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:28.317209 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:28.317498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:28.317778 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] PATH_INFO: `/v3/projects` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:28.318559 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:28.318874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:28.320301 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cea642-94ca-4708-abce-cc2355880be4 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:28.332811 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 632/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:28.340111 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:28.366318 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:28.442397 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce069d95-15d0-48fe-af59-eed9622f87aa None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:28.477485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:28.478176 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:28.478468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:28.478746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:28.479567 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=f830d079afc149b392bff5fb9a76c9f5) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:28.479881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:28.481385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7547-282a-4b19-a7eb-f09ecd786a61 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:28.486805 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 628/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:08:28 2022] GET /identity/v3/role_assignments?user.id=f830d079afc149b392bff5fb9a76c9f5&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:30.499446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e437da-65d0-48a7-b021-95369f2b73e8 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:30.500013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e437da-65d0-48a7-b021-95369f2b73e8 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:30.500013 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e437da-65d0-48a7-b021-95369f2b73e8 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:30.501467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 633/1261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:30.506654 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:30.507122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:30.507264 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:30.524427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:30.529266 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:30.591380 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:30.614478 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e437da-65d0-48a7-b021-95369f2b73e8 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:30.625963 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:30.715876 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e437da-65d0-48a7-b021-95369f2b73e8 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:30.750328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:30.751056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:30.751339 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:30.751613 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:30.761979 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:30.769693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:30.773553 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:30.774467 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 634/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:30.777000 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:30.795492 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:30.873808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647452a7-d25f-4793-aa1f-70a2e8e6113c None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:30.907230 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:30.907886 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:30.908166 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:30.908461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] PATH_INFO: `/v3/roles` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:30.909205 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:30.909554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:30.910961 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:30.919374 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 630/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:30.925047 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:30.991976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:31.026076 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f894-641e-4cfe-a136-f03558566d89 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.058647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.059438 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.059726 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.060001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.071022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.072493 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:31.090483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:31.091946 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:31.093279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:31.093279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:31.093279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:31.093279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:31.093279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 635/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:31.097468 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.178921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:31.197117 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85466d1b-4a22-4490-97c0-c926612c0a7c None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.230419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.231101 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.231383 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.231668 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.232390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:31.232730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.234118 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.245750 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 631/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:31.251458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.349869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ef823-d3c8-413f-85ed-d7f4ddd07abc None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.369180 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:31.383226 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.384139 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.384974 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.385417 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.393511 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.402868 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:31.409583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:31.410815 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:31.411903 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 636/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:31.416633 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.520198 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a517e3-32f2-4f1d-9397-0934c98c97b9 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.553842 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.554520 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.554844 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.555177 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] PATH_INFO: `/v3/users` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.556131 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:31.556485 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.557927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.566946 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:31.575773 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 632/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:31.581522 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.680487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d4442-4b60-4b4a-b44a-b7e19e1002b9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.713546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.714337 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.714618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.714888 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.725485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.726898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:31.744878 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:31.749437 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:31.750642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:31.750642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:31.750642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:31.750642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:31.750642 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 637/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:31.751979 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.849837 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa50eb2-03a2-4796-a084-3f7794f8f426 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:31.883889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:31.885123 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:31.885407 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:31.885683 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:31.886400 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:31.886704 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:31.888068 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:31.899029 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 633/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:31.904769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:31.936058 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:32.001391 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b25f1-ed84-4836-a28b-3e78d1e44ec9 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:32.034646 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:32.035453 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:32.035721 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:32.035997 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:32.042482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:32.043921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:32.058033 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:32.059203 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:32.060460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 638/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:32.065241 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:32.123186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:32.165292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f74acb-6baa-42f6-b48c-c83160ff2471 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:32.198854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:32.199439 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:32.199721 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:32.199996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:32.200808 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:32.201121 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:32.202548 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffaf59-7a50-43b7-9e8f-bba9e433b5b4 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:32.214594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 634/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:32.220769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:32.311102 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:32.319291 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a282-e938-4737-9251-af80c5ebd9d8 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:32.352056 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:32.353485 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] REQUEST_METHOD: `PUT` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:32.353772 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:32.354048 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] PATH_INFO: `/v3/projects/8795985765494c388bc3251da0c22cf6/users/f830d079afc149b392bff5fb9a76c9f5/roles/735ab5a0807540ac8694a65c7eac940b` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:32.355969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8795985765494c388bc3251da0c22cf6, user_id=f830d079afc149b392bff5fb9a76c9f5, role_id=735ab5a0807540ac8694a65c7eac940b)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:32.357411 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1609d-6bec-41fc-9cfe-99209cffb7f6 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:32.422881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:08:32 2022] PUT /identity/v3/projects/8795985765494c388bc3251da0c22cf6/users/f830d079afc149b392bff5fb9a76c9f5/roles/735ab5a0807540ac8694a65c7eac940b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:08:34.419024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5996a-6870-4c19-b46d-6e56aceaac22 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:34.419610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5996a-6870-4c19-b46d-6e56aceaac22 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:34.419610 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5996a-6870-4c19-b46d-6e56aceaac22 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:34.421103 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 635/1274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:34.426345 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:34.426770 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:34.426892 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:34.443177 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:34.444343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:34.510283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:34.535243 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5996a-6870-4c19-b46d-6e56aceaac22 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:34.638543 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5996a-6870-4c19-b46d-6e56aceaac22 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:34.655777 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:34.671984 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:34.672747 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:34.673029 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:34.673303 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:34.683062 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:08:34.690754 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:34.692079 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:34.695175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 636/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:34.698737 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:34.780891 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:34.798479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f129d-017f-4055-9294-9f1d197bfd5a None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:34.832373 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:34.833068 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:34.833350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:34.833625 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] PATH_INFO: `/v3/roles` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:34.834369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] RBAC: Adding query filter params (name=admin) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:34.834718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:34.836134 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:34.843940 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 641/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:34.849819 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:34.950382 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876290e0-da00-4057-8b68-fc3c023abd41 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:34.982709 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:34.983552 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:34.983833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:34.984110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:34.995093 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:34.996605 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:35.014461 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:35.015680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:35.017592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:35.017592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:35.017592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:35.017592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:35.017592 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 637/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:35.021685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:35.122822 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe654b-466a-4216-b636-db70e5ac9374 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:35.157258 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:35.157924 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:35.158211 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:35.158494 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] PATH_INFO: `/v3/domains` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:35.159210 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:35.159520 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:35.160923 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.173007 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 642/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:35.180802 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:35.215489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:35.284384 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7e287-ca17-4075-8b88-beca17996a12 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:35.318652 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:35.319449 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:35.319731 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:35.320004 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:35.327022 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:35.328490 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:08:35.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:35.344296 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:35.345431 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 638/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:35.350091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:35.354483 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:35.448840 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5656817-84e9-4330-b653-4039a2888b37 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:35.481839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:35.482446 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:35.482728 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:35.483004 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] PATH_INFO: `/v3/users` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:35.483864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:35.484177 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:35.485621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.502762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 643/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:35.508848 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:35.599675 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:35.609729 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ac70-cf43-4449-a998-f694600e5f28 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:35.643313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:35.643960 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:35.644247 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:35.644554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:35.711207 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:35.713448 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.800342 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:35.810493 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:08:35.816507 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:35.877422 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:35.915672 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd6b36-96d8-4071-8fce-f89a86d01915 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:35.947683 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:35.948524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:35.948812 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:35.949087 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:35.959276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:35.960767 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:08:35.977959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:35.979142 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:35.980338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:08:35.980338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:08:35.980338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:08:35.980338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:35.980338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 644/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:35.985136 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:36.082509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cafc2ab-bd22-42de-8da6-af091fb6b785 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:36.116297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:36.116986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:36.117272 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:36.117553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] PATH_INFO: `/v3/domains` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:36.118282 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] RBAC: Adding query filter params (name=Default) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:36.118597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:36.120100 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:36.131437 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 640/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:36.138151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:36.242842 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e8415-5ce7-4f43-9a09-b58b4612e7a3 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:36.261761 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:36.282853 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:36.283649 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:36.283935 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:36.284215 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:36.290754 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:36.292175 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:08:36.306656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:36.307787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: ERROR keystone.server.flask.application Jun 29 23:08:36.309220 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 645/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:08:36.313792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:36.363673 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:36.413304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a1c76-c655-4d6a-b199-7322999d609a None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:36.447347 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:36.448018 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:36.448301 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:36.448636 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] PATH_INFO: `/v3/projects` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:36.455931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:36.455931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:36.455931 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c69c9c-a471-44b0-8847-d6fa56a5569c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:36.462830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 641/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:08:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:36.469054 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:36.573990 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686344-6f84-4141-974e-3e2eb87e7f5a None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:36.607715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:36.608366 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:36.608693 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:36.608969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:36.609784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] RBAC: Adding query filter params (role.id=735ab5a0807540ac8694a65c7eac940b, scope.project.id=8795985765494c388bc3251da0c22cf6, user.id=f830d079afc149b392bff5fb9a76c9f5) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:36.610191 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:36.611635 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34154a26-0eb2-4a70-bac5-7ca3666ef509 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:36.617895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 646/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:08:36 2022] GET /identity/v3/role_assignments?user.id=f830d079afc149b392bff5fb9a76c9f5&scope.project.id=8795985765494c388bc3251da0c22cf6&role.id=735ab5a0807540ac8694a65c7eac940b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:38.650337 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111cc9d-c9f1-4bef-a191-1dfd64aec5d4 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:38.650941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111cc9d-c9f1-4bef-a191-1dfd64aec5d4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:38.650941 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111cc9d-c9f1-4bef-a191-1dfd64aec5d4 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:38.652239 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 642/1288] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:38.657612 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:38.658011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:38.658183 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:38.675501 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:38.685214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:38.706154 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:38.744326 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:38.767438 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111cc9d-c9f1-4bef-a191-1dfd64aec5d4 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:38.869458 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111cc9d-c9f1-4bef-a191-1dfd64aec5d4 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:38.880569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:38.904628 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:38.905359 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:38.905641 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:38.905915 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] PATH_INFO: `/v3/services/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:38.906597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:38.907965 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:38.919645 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:38.921045 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:38.921980 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 643/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:08:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:38.927074 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:39.025359 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142ffc0-e23a-4fbd-8be8-2283b80c496e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:39.058656 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:39.059309 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:39.059591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:39.059865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:39.060592 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:39.060898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:39.062245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bb7d9-babe-44bf-a6a4-54926cc078a2 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:39.067049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 648/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:08:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:39.073424 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:39.173903 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790ac0b-5fbc-4d9d-9480-0eb3a2729a54 None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:39.207799 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:39.208477 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:39.208763 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:39.209039 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] PATH_INFO: `/v3/services` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:39.209743 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] RBAC: Adding query filter params (type=placement) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:39.210051 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:39.211427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7db67-6bf3-47ad-ad13-9a2db4c6ed27 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:39.216414 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 644/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:08:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:08:41.219091 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791f9ce-d56f-4b86-aed3-86dcdbaa2471 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:41.219664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791f9ce-d56f-4b86-aed3-86dcdbaa2471 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:41.219664 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791f9ce-d56f-4b86-aed3-86dcdbaa2471 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:41.221108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 649/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:41.226324 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4f583-8249-41cd-bbeb-bf08c10aed14 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:41.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4f583-8249-41cd-bbeb-bf08c10aed14 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:41.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4f583-8249-41cd-bbeb-bf08c10aed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:41.244442 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-acf4f583-8249-41cd-bbeb-bf08c10aed14 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:41.245629 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-acf4f583-8249-41cd-bbeb-bf08c10aed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:41.274203 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:41.310215 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 645/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:41.332938 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791f9ce-d56f-4b86-aed3-86dcdbaa2471 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:41.363571 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:41.433641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791f9ce-d56f-4b86-aed3-86dcdbaa2471 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:41.468185 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:41.468880 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:41.469214 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:41.469439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:41.470148 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:41.471548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab194143-fc76-4714-b6b1-46b207120633 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:41.564747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 650/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:08:41 2022] POST /identity/v3/services => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:08:43.602010 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7768f-bd04-4c1f-b364-964ea22c4853 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:43.602597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7768f-bd04-4c1f-b364-964ea22c4853 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:43.602597 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7768f-bd04-4c1f-b364-964ea22c4853 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:43.603921 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 646/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:43.609024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:43.609428 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:43.609593 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:43.626085 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:43.627261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:43.698689 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:43.721985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7768f-bd04-4c1f-b364-964ea22c4853 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:43.822994 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7768f-bd04-4c1f-b364-964ea22c4853 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:43.856009 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:43.856762 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:43.857049 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:43.857328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] PATH_INFO: `/v3/services/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:43.857989 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:43.859360 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:43.871831 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:43.873159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:43.874281 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 647/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:08:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:43.879024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:43.897896 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:43.978516 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5048d46-1bc5-4eeb-a438-28fad5e66c24 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:44.011902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:44.012589 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:44.012875 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:44.013152 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:44.013855 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] RBAC: Adding query filter params (name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:44.014165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:44.015526 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:44.020785 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 652/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:08:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:44.026506 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:44.057963 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:44.125421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32c83-26f7-415c-8ab8-e40de774a56f None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:44.159245 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:44.159900 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:44.160186 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:44.160498 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:44.161294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] RBAC: Adding query filter params (interface=public, service_id=766dc75196c946a9a83dafa6284a1837, region_id=RegionOne) {{(pid=221126) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:44.161609 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:44.162992 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a4c8b-5a76-4bb5-92d1-d8f0f6f18a5c None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:44.168680 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 648/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:08:44 2022] GET /identity/v3/endpoints?service_id=766dc75196c946a9a83dafa6284a1837&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:44.174670 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:44.254604 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:44.271904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d4a4-6260-4642-afba-3624d8209b95 None admin] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:44.304781 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:44.305496 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:44.306289 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:44.306564 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:44.307242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:44.308628 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2868b2-639b-4c62-b330-2405d7e678d5 None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:44.315482 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 653/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:08:44 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:08:46.322163 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87a9a-eaae-451f-bc5f-8a6a900a15e6 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:46.322726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87a9a-eaae-451f-bc5f-8a6a900a15e6 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:46.322726 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87a9a-eaae-451f-bc5f-8a6a900a15e6 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:46.324094 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 649/1302] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:08:46.329441 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:46.329959 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:46.330066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:46.346458 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:08:46.347618 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:08:46.412160 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:08:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:08:46.436945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87a9a-eaae-451f-bc5f-8a6a900a15e6 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:46.530462 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:46.536978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87a9a-eaae-451f-bc5f-8a6a900a15e6 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:46.570220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:46.571551 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:46.571838 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:46.572115 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:46.572850 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:46.574172 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:08:46.586331 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:08:46.588221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application with Lock( Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: ERROR keystone.server.flask.application Jun 29 23:08:46.589569 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 650/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:08:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:08:46.594420 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:46.669184 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:46.691281 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2599-0b2a-40bb-ba66-a99cdbf41edf None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:46.725342 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:46.726011 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:46.726300 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:46.726590 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] PATH_INFO: `/v3/services` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:46.727297 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=221125) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:08:46.727615 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:46.729012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed939a7-d7b1-4895-adb3-b5bdfe5d8a4e None admin] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:46.734159 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 655/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:08:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:08:46.739949 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:08:46.839945 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd3251-bb6b-4f23-b712-a4b301458e5d None admin] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:08:46.872986 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e15b0f3d7b74d6297fef6ab4fc9c8de', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:08:46.873626 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:08:46.873908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:08:46.874948 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] PATH_INFO: `/v3/endpoints` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:08:46.874948 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:08:46.876328 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acec764-1276-425d-9f06-bffec2b0b100 None admin] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:08:46.967811 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:08:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:08:56.744850 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=30 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:08:56.963006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:23.447199 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e06a-12d5-4bdc-97c7-e02374d9847d None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:23.447786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e06a-12d5-4bdc-97c7-e02374d9847d None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:23.447786 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01e06a-12d5-4bdc-97c7-e02374d9847d None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:23.449176 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 656/1307] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:23.454386 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b5f7-ae3d-4959-8019-a90fb302c69c None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:23.457909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b5f7-ae3d-4959-8019-a90fb302c69c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:23.457909 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9b5f7-ae3d-4959-8019-a90fb302c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:23.590258 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-aff9b5f7-ae3d-4959-8019-a90fb302c69c None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:23.591728 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-aff9b5f7-ae3d-4959-8019-a90fb302c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:23.708977 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:23.781172 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593502-69c0-4267-b791-56a080431e1e None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:23.781659 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593502-69c0-4267-b791-56a080431e1e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:23.782113 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec593502-69c0-4267-b791-56a080431e1e None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:23.783647 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 657/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 23:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:23.797091 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc413-6738-4dfb-8238-fe511400413d None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:23.797304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc413-6738-4dfb-8238-fe511400413d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:23.797572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc413-6738-4dfb-8238-fe511400413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:23.946924 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9bccc413-6738-4dfb-8238-fe511400413d None None] MFA Rules not processed for user `9b0efc8226b943e583cc04914602f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:23.948187 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9bccc413-6738-4dfb-8238-fe511400413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:23.994662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:24.110661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 23:15:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:15:24.121024 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593502-69c0-4267-b791-56a080431e1e None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:24.122795 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ec593502-69c0-4267-b791-56a080431e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:24.267133 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec593502-69c0-4267-b791-56a080431e1e None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:24.347521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:24.348182 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:24.348487 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:24.348771 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:24.350435 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:24.411690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:24.494012 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:24.495461 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f5f16-6803-46d7-9382-f0bbd70ab965 service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:24.543343 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 658/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:27.262912 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:27.263385 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:27.263601 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:27.265024 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 654/1312] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:27.270304 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ceae2-f0f0-495c-97e4-09a82dc8d4f5 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:27.270707 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ceae2-f0f0-495c-97e4-09a82dc8d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:27.270871 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ceae2-f0f0-495c-97e4-09a82dc8d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:27.362031 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-9c0ceae2-f0f0-495c-97e4-09a82dc8d4f5 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:27.363236 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-9c0ceae2-f0f0-495c-97e4-09a82dc8d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:27.461268 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:27.499159 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:27.501200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:27.608501 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0099fd-16b3-4ad1-b1a2-1c36bf14573d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:27.682688 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:27.686554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:27.687228 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:27.687515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:27.687796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:27.689598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:27.813841 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:27.815313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202938e-bf6a-4934-a3e0-2fb2f7f148e5 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:27.835593 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 655/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:30.391060 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701644f4-278f-4cf8-a015-80edd156105f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:30.391621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701644f4-278f-4cf8-a015-80edd156105f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:30.391621 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701644f4-278f-4cf8-a015-80edd156105f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:30.392971 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 660/1315] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:30.398157 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494906b-34c3-44fe-8e6f-652db9c8def5 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:30.398594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494906b-34c3-44fe-8e6f-652db9c8def5 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:30.398732 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494906b-34c3-44fe-8e6f-652db9c8def5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:30.464060 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-6494906b-34c3-44fe-8e6f-652db9c8def5 None None] MFA Rules not processed for user `489b4d6344e34e25b0feebe79fcb5456`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:30.465525 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6494906b-34c3-44fe-8e6f-652db9c8def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:30.516816 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:30.560260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:30.599548 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701644f4-278f-4cf8-a015-80edd156105f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:30.601151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-701644f4-278f-4cf8-a015-80edd156105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:30.611369 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:30.705639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701644f4-278f-4cf8-a015-80edd156105f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:30.780667 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:30.781308 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:30.781591 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:30.781865 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:30.783488 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:30.844078 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:30.890717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:30.892151 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb70562-d725-4133-be0f-feedc6a3d2b7 service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:30.910748 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 661/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:33.788604 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:33.789153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:33.789153 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:33.791106 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 657/1318] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:33.796229 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981198a-2456-472d-8a06-39707a948052 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:33.796660 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981198a-2456-472d-8a06-39707a948052 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:33.796832 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981198a-2456-472d-8a06-39707a948052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:33.860362 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-1981198a-2456-472d-8a06-39707a948052 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:33.861599 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-1981198a-2456-472d-8a06-39707a948052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:33.956650 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 662/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:33.996006 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:33.997576 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:34.100291 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eaed4-192a-4649-8234-16c0a84136cf None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:34.171218 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:34.171852 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:34.172135 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:34.172428 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:34.174041 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:34.181220 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:34.280655 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:34.282017 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b566-13bc-47b7-b894-00dbbe59b600 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:34.299369 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 658/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:37.297762 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:37.298336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:37.298336 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:37.299711 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 663/1321] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:37.304934 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f4ec9-1a7d-40c7-9ba7-b8f433bdba4b None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:37.305348 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f4ec9-1a7d-40c7-9ba7-b8f433bdba4b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:37.305596 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f4ec9-1a7d-40c7-9ba7-b8f433bdba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:37.370557 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-184f4ec9-1a7d-40c7-9ba7-b8f433bdba4b None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:37.371795 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-184f4ec9-1a7d-40c7-9ba7-b8f433bdba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:37.431746 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:37.470928 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 659/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:37.507975 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:37.510261 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:37.533616 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:37.624529 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36a6d6-6af0-41b9-8354-3011f1678867 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:37.702034 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:37.702691 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:37.702976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:37.703253 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:37.704937 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:37.779241 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:37.817864 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:37.819313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a309d-3fdf-44c8-a680-bf5222bedb61 service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:37.837943 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 664/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:39.957235 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:39.957756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:39.957756 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:39.959248 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 660/1324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:39.965498 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41229-209b-4f22-8ed2-c6320469212a None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:39.966106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41229-209b-4f22-8ed2-c6320469212a None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:39.966106 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41229-209b-4f22-8ed2-c6320469212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:40.040551 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-9cd41229-209b-4f22-8ed2-c6320469212a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:40.041769 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-9cd41229-209b-4f22-8ed2-c6320469212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:40.148449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 665/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:40.178401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:40.180059 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:40.285521 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc3f9-831c-4727-9ec2-eea4efefbf9d None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:40.362259 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:40.365469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:40.365469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:40.365469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:40.365469 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:40.382357 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:40.475708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:40.477180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84258386-c0e1-4dc3-9103-12cdb2d18d67 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:40.496125 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 661/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:42.581479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e941-1b00-4c9f-b59f-dcf6881a21ea None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:42.582066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e941-1b00-4c9f-b59f-dcf6881a21ea None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:42.582066 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e941-1b00-4c9f-b59f-dcf6881a21ea None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:42.583431 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 666/1327] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:42.589196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87874e-709a-4b8c-b638-34e01b2775f7 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:42.589632 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87874e-709a-4b8c-b638-34e01b2775f7 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:42.589757 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87874e-709a-4b8c-b638-34e01b2775f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:42.652466 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-1f87874e-709a-4b8c-b638-34e01b2775f7 None None] MFA Rules not processed for user `489b4d6344e34e25b0feebe79fcb5456`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:42.653646 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-1f87874e-709a-4b8c-b638-34e01b2775f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:42.716870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:42.748237 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 662/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:42.802395 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:42.802685 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:42.802966 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:42.804338 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 667/1329] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 23:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:42.810199 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3581e-f079-431b-b531-5764cfc5848e None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:42.810489 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3581e-f079-431b-b531-5764cfc5848e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:42.810769 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3581e-f079-431b-b531-5764cfc5848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:42.883735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-85a3581e-f079-431b-b531-5764cfc5848e None None] MFA Rules not processed for user `9b0efc8226b943e583cc04914602f2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:42.884892 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-85a3581e-f079-431b-b531-5764cfc5848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:42.959265 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 663/1330] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 23:15:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:42.969051 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:42.970577 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:43.002421 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:43.075976 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6618b4-b60f-4367-b039-d1025a9788cf None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:43.146977 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:43.147549 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:43.147831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:43.148103 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:43.150388 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:43.225718 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:43.257278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:43.259206 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f6cdb-abfb-407b-b6df-3e017abdbfed service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:43.277831 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 668/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:46.082534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:46.083058 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:46.083156 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:46.084572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 664/1332] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:46.090457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa434-9406-42d4-85de-2a04d62fbce4 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:46.090905 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa434-9406-42d4-85de-2a04d62fbce4 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:46.091006 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afa434-9406-42d4-85de-2a04d62fbce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:46.155333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-86afa434-9406-42d4-85de-2a04d62fbce4 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:46.156546 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-86afa434-9406-42d4-85de-2a04d62fbce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:46.250242 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 669/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:46.287304 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:46.288890 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:46.364677 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:46.393957 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a9c25-7668-41be-8960-069a3fc76965 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:46.466982 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:46.467627 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:46.467919 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:46.468196 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:46.469894 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:46.576353 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:46.577839 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e0d11-07c9-4591-acb1-3d9c6737dea9 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:46.587705 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:46.596181 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 665/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:48.683039 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:48.683619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:48.683619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:48.685007 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 670/1335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:48.690292 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038fdd9-3986-401d-ae64-f7303877a248 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:48.690708 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038fdd9-3986-401d-ae64-f7303877a248 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:48.690853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038fdd9-3986-401d-ae64-f7303877a248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:48.755183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-4038fdd9-3986-401d-ae64-f7303877a248 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:48.756427 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-4038fdd9-3986-401d-ae64-f7303877a248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:48.851008 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 666/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:48.892328 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:48.893890 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:48.934174 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:48.996738 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566efb-4f9d-45af-bbcb-0f8dd7795bf3 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:49.068902 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:49.069544 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:49.069829 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:49.070111 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:49.071784 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:49.152175 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:49.177344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:49.178779 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b7a7d-9a1e-4e43-b578-fddaf54c31c6 service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:49.197787 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 671/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:51.989753 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:51.990277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:51.990277 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:51.991588 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 667/1338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:51.997560 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299faf-42c9-4a1e-aaed-5942cd79f686 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:51.998017 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299faf-42c9-4a1e-aaed-5942cd79f686 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:51.998125 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4299faf-42c9-4a1e-aaed-5942cd79f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:52.062690 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-d4299faf-42c9-4a1e-aaed-5942cd79f686 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:52.063895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-d4299faf-42c9-4a1e-aaed-5942cd79f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:52.160144 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:15:52.195515 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:52.197077 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:52.278578 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:52.306099 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d7c4d-fa74-4c15-8141-dce81164e564 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:52.382847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:52.383503 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:52.383792 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:52.384072 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:52.385864 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:52.498209 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:52.499643 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098adfc7-80e9-4b55-8bf9-cb522d139554 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:52.518293 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 668/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:15:56.828638 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:56.829163 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:56.829824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:56.831150 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 673/1341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:15:56.836630 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f804-042f-434b-b15f-d5a81d764687 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:56.837096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f804-042f-434b-b15f-d5a81d764687 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:56.837192 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80f804-042f-434b-b15f-d5a81d764687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:56.843480 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=100 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:56.917063 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9b80f804-042f-434b-b15f-d5a81d764687 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:15:56.918334 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9b80f804-042f-434b-b15f-d5a81d764687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:57.023278 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:15:57.062324 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:15:57.064489 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:15:57.113705 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:15:57.160524 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b21100-3478-4ed0-8ee2-708407f30ce1 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:15:57.164135 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:15:57.164828 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:15:57.165120 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:15:57.165400 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:15:57.175071 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:15:57.176547 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec461c-a9a2-4004-9e66-1148dfc9271b service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:15:57.186574 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 674/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:00.212251 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:00.212908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:00.212908 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:00.214288 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 670/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:00.220263 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338179b8-d1dd-4556-8332-1e3ecbfcea54 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:00.220841 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338179b8-d1dd-4556-8332-1e3ecbfcea54 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:00.220954 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338179b8-d1dd-4556-8332-1e3ecbfcea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:00.249519 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-338179b8-d1dd-4556-8332-1e3ecbfcea54 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:00.250736 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-338179b8-d1dd-4556-8332-1e3ecbfcea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:00.328313 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:00.369167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:00.369167 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:00.382087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d7946-2916-4977-a6bb-4e8fc7a2e26e None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:00.385554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:00.386189 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:00.386472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:00.386796 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:00.395730 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:00.397735 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6944f-7d56-4fc8-b04b-8f026050a846 service neutron] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:00.407200 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 671/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:04.980518 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3688c-3b34-4232-987d-bfcb051e4334 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:04.981124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3688c-3b34-4232-987d-bfcb051e4334 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:04.981124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3688c-3b34-4232-987d-bfcb051e4334 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:04.982610 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 676/1347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:04.988297 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977213-9ba0-4f71-abbe-2d2e5822cc90 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:04.988843 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977213-9ba0-4f71-abbe-2d2e5822cc90 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:04.988983 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977213-9ba0-4f71-abbe-2d2e5822cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:05.008373 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-9a977213-9ba0-4f71-abbe-2d2e5822cc90 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:05.009165 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-9a977213-9ba0-4f71-abbe-2d2e5822cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:05.018087 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:05.059688 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3688c-3b34-4232-987d-bfcb051e4334 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:05.071355 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3688c-3b34-4232-987d-bfcb051e4334 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:05.075508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b0efc8226b943e583cc04914602f2a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:05.076160 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:05.076475 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:05.076756 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:05.086527 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:05.087892 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a6f96-ea1b-49c0-9e25-a0e9a0f50ae8 service neutron] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:05.097952 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 677/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:10.227426 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f625-64f8-48ca-97fa-dca752ebcae9 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:10.227911 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f625-64f8-48ca-97fa-dca752ebcae9 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:10.227996 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f625-64f8-48ca-97fa-dca752ebcae9 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:10.235780 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 673/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:16:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:10.241317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ac67-b816-4015-a92c-c2f7d023df1b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:10.242165 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ac67-b816-4015-a92c-c2f7d023df1b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:10.242686 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81ac67-b816-4015-a92c-c2f7d023df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:10.337124 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-1e81ac67-b816-4015-a92c-c2f7d023df1b None None] MFA Rules not processed for user `f830d079afc149b392bff5fb9a76c9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:10.339137 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-1e81ac67-b816-4015-a92c-c2f7d023df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:10.371414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:16:10.425639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:16:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:16:14.630175 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6469d5-4838-4d2e-bc15-36b9392296e3 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:14.631934 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6469d5-4838-4d2e-bc15-36b9392296e3 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:14.632928 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6469d5-4838-4d2e-bc15-36b9392296e3 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:14.635421 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 674/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:16:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:14.640303 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e1f-e86d-4564-a31d-a5a262d5a559 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:14.640777 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e1f-e86d-4564-a31d-a5a262d5a559 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:14.641016 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50e1f-e86d-4564-a31d-a5a262d5a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:14.659639 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-66a50e1f-e86d-4564-a31d-a5a262d5a559 None None] MFA Rules not processed for user `f830d079afc149b392bff5fb9a76c9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:14.660928 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-66a50e1f-e86d-4564-a31d-a5a262d5a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:14.669873 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:16:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:15.002221 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=72 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:16:16.188185 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c089-45ab-4217-b35e-e46070dc5a3b None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:16.188847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c089-45ab-4217-b35e-e46070dc5a3b None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:16.188847 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792c089-45ab-4217-b35e-e46070dc5a3b None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:16.190112 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 675/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:16.195068 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ded-1924-4414-9d09-7af913430777 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:16.195586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ded-1924-4414-9d09-7af913430777 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:16.195747 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c5ded-1924-4414-9d09-7af913430777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:16.215739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ac4c5ded-1924-4414-9d09-7af913430777 None None] MFA Rules not processed for user `f830d079afc149b392bff5fb9a76c9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:16.216969 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ac4c5ded-1924-4414-9d09-7af913430777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:16.225881 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:16:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:19.860294 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655023f-b8e7-48c8-90ea-b54cacc8d360 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:19.861240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655023f-b8e7-48c8-90ea-b54cacc8d360 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:19.861718 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655023f-b8e7-48c8-90ea-b54cacc8d360 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:19.863634 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 676/1356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:19.870372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21646e-f3ea-432c-88c2-194f4ab13108 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:19.870372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21646e-f3ea-432c-88c2-194f4ab13108 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:19.870372 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21646e-f3ea-432c-88c2-194f4ab13108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:19.898357 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ef21646e-f3ea-432c-88c2-194f4ab13108 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:19.899824 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ef21646e-f3ea-432c-88c2-194f4ab13108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:19.909631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:16:19.974748 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835516-7c95-45ee-9132-7acdf252370e None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:19.975272 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835516-7c95-45ee-9132-7acdf252370e None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:19.975623 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20835516-7c95-45ee-9132-7acdf252370e None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:19.984472 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 677/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 23:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:19.992602 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3d6d3-7959-460d-bf51-dff1cce32b89 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:19.993108 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3d6d3-7959-460d-bf51-dff1cce32b89 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:19.993555 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3d6d3-7959-460d-bf51-dff1cce32b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:20.048040 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-12d3d6d3-7959-460d-bf51-dff1cce32b89 None None] MFA Rules not processed for user `fe2c18b13963439cbe1685ce9a1f9c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:20.049335 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-12d3d6d3-7959-460d-bf51-dff1cce32b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:20.154007 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 23:16:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:20.154955 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20835516-7c95-45ee-9132-7acdf252370e None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:20.171065 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20835516-7c95-45ee-9132-7acdf252370e None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:20.176749 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:20.177475 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:20.177833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:20.178182 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:20.188180 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:20.190011 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5addcc-3794-4e3d-bd63-e5a841cda26b service nova] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:20.201225 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 678/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:22.464716 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b420-2e4d-46f5-a108-8f7b52841a49 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:22.465283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b420-2e4d-46f5-a108-8f7b52841a49 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:22.465283 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25b420-2e4d-46f5-a108-8f7b52841a49 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:22.466657 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 683/1361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:22.472183 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3873-99a4-4a0c-95b1-d3ef3a17de43 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:22.472737 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3873-99a4-4a0c-95b1-d3ef3a17de43 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:22.472964 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f3873-99a4-4a0c-95b1-d3ef3a17de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:22.491453 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-2f2f3873-99a4-4a0c-95b1-d3ef3a17de43 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:22.492978 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-2f2f3873-99a4-4a0c-95b1-d3ef3a17de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:22.502648 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:22.547390 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25b420-2e4d-46f5-a108-8f7b52841a49 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:22.562277 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25b420-2e4d-46f5-a108-8f7b52841a49 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:22.567845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:22.568517 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:22.568805 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:22.569114 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:22.578095 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:22.579692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7886e-dc32-4d85-a3de-7708d4282927 service nova] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:22.589508 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 684/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:25.094793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd522-6510-4449-bd76-a07ec1f08758 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:25.095313 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd522-6510-4449-bd76-a07ec1f08758 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:25.095452 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd522-6510-4449-bd76-a07ec1f08758 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:25.097191 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 680/1364] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:25.112586 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad4e0-c082-4f3a-9ee3-14d5d38f939e None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:25.113027 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad4e0-c082-4f3a-9ee3-14d5d38f939e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:25.113130 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ad4e0-c082-4f3a-9ee3-14d5d38f939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:25.131535 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-170ad4e0-c082-4f3a-9ee3-14d5d38f939e None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:25.133001 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-170ad4e0-c082-4f3a-9ee3-14d5d38f939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:25.141504 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:16:25.189758 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6e64-6570-47c2-9456-d36c1457ddc4 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:25.190122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6e64-6570-47c2-9456-d36c1457ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:25.190465 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6e64-6570-47c2-9456-d36c1457ddc4 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:25.191881 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 681/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 23:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:25.198041 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6344e0-37de-476a-875d-49e8e158b6fb None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:25.198333 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6344e0-37de-476a-875d-49e8e158b6fb None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:25.198641 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6344e0-37de-476a-875d-49e8e158b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:25.217678 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-8f6344e0-37de-476a-875d-49e8e158b6fb None None] MFA Rules not processed for user `fe2c18b13963439cbe1685ce9a1f9c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:25.218863 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-8f6344e0-37de-476a-875d-49e8e158b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:25.228094 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 23:16:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:16:25.235818 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6e64-6570-47c2-9456-d36c1457ddc4 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:25.250857 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6e64-6570-47c2-9456-d36c1457ddc4 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:25.256473 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:25.257110 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:25.257401 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:25.257682 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:25.266470 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:25.268054 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85217237-bc1a-4a18-82c5-4c2321420c72 service nova] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:25.277788 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 682/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 23:16:27.585936 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dec27f-a4f7-42e2-9581-0032231f110f None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:27.586503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dec27f-a4f7-42e2-9581-0032231f110f None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:27.586503 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dec27f-a4f7-42e2-9581-0032231f110f None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:27.587904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 687/1369] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:27.593516 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871936-0c01-4b81-82b0-a1ca31471c73 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:27.593947 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871936-0c01-4b81-82b0-a1ca31471c73 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:27.594096 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871936-0c01-4b81-82b0-a1ca31471c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:27.613354 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-85871936-0c01-4b81-82b0-a1ca31471c73 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:27.614554 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-85871936-0c01-4b81-82b0-a1ca31471c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:27.623092 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:27.667327 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dec27f-a4f7-42e2-9581-0032231f110f None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:27.682123 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dec27f-a4f7-42e2-9581-0032231f110f None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:27.688022 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:27.688874 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:27.689166 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:27.689447 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:27.698162 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:27.699755 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed8cf05-1083-4470-8a31-a9e4f12f583c service nova] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:27.709845 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 688/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:28.225089 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578748-3d62-4381-b106-dec7959967a8 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:28.225481 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578748-3d62-4381-b106-dec7959967a8 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:28.225943 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d578748-3d62-4381-b106-dec7959967a8 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:28.227534 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 684/1372] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:28.233414 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5238-3ab7-493a-b22f-ba6e943910fc None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:28.233739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5238-3ab7-493a-b22f-ba6e943910fc None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:28.234049 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b5238-3ab7-493a-b22f-ba6e943910fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:28.252350 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-ba5b5238-3ab7-493a-b22f-ba6e943910fc None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:28.253859 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-ba5b5238-3ab7-493a-b22f-ba6e943910fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:28.261982 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 689/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:28.574821 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee430-5deb-4680-b17d-0dd2f59f7417 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:28.575122 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee430-5deb-4680-b17d-0dd2f59f7417 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:28.576267 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dee430-5deb-4680-b17d-0dd2f59f7417 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:28.576833 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 685/1374] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jun 29 23:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:28.582088 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92066eb7-483b-4c92-9181-0a08d673a17b None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:28.582583 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92066eb7-483b-4c92-9181-0a08d673a17b None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:28.583032 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92066eb7-483b-4c92-9181-0a08d673a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:28.591153 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=100 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:16:28.637758 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-92066eb7-483b-4c92-9181-0a08d673a17b None None] MFA Rules not processed for user `6b419d0f016a46468640dcc675629c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:28.639138 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-92066eb7-483b-4c92-9181-0a08d673a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:28.703189 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jun 29 23:16:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:28.711877 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dee430-5deb-4680-b17d-0dd2f59f7417 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:28.728631 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dee430-5deb-4680-b17d-0dd2f59f7417 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:28.732509 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b419d0f016a46468640dcc675629c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:28.733222 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:28.733572 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:28.733939 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:28.744240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:28.745825 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c78e-1781-4de0-a236-9c341a6a3d5d service cinder] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:28.756257 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 686/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:29.945086 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1016-7dd0-488e-9ac5-03e844927ba6 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:29.945692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1016-7dd0-488e-9ac5-03e844927ba6 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:29.945692 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1016-7dd0-488e-9ac5-03e844927ba6 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:29.947652 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 691/1377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:29.953031 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b019d-b1e3-42f7-a8ed-ac135f2817af None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:29.953487 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b019d-b1e3-42f7-a8ed-ac135f2817af None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:29.953717 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b019d-b1e3-42f7-a8ed-ac135f2817af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:29.971325 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-056b019d-b1e3-42f7-a8ed-ac135f2817af None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:29.972553 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-056b019d-b1e3-42f7-a8ed-ac135f2817af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:29.980307 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:30.024766 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c1016-7dd0-488e-9ac5-03e844927ba6 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:30.039062 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c1016-7dd0-488e-9ac5-03e844927ba6 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:30.044521 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:30.045158 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:30.045442 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:30.045722 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:30.053994 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:30.055619 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b824c-3c18-479f-82a4-4ff40f313bc4 service nova] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:30.065904 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 692/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:32.295932 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ee5-aba1-40df-8d29-9d192784dc2c None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:32.296479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ee5-aba1-40df-8d29-9d192784dc2c None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:32.296479 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1355ee5-aba1-40df-8d29-9d192784dc2c None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:32.297793 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 688/1380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:32.302869 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39263ea-4cc1-45ae-b8bc-f042007819ab None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:32.303280 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39263ea-4cc1-45ae-b8bc-f042007819ab None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:32.303443 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39263ea-4cc1-45ae-b8bc-f042007819ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:32.322245 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-b39263ea-4cc1-45ae-b8bc-f042007819ab None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:32.323439 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-b39263ea-4cc1-45ae-b8bc-f042007819ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:32.331302 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:32.375613 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355ee5-aba1-40df-8d29-9d192784dc2c None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:32.390612 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1355ee5-aba1-40df-8d29-9d192784dc2c None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:32.395920 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:32.396583 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:32.396865 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:32.398696 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:32.406020 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:32.407662 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca1e7a-3dc9-4e9a-858b-fa18c6ba5191 service nova] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:32.417701 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 689/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:34.663331 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac6c7-1f0b-41a8-95ef-79ecc7092a40 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:34.663909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac6c7-1f0b-41a8-95ef-79ecc7092a40 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:34.663909 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ac6c7-1f0b-41a8-95ef-79ecc7092a40 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:34.665856 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 694/1383] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:34.671234 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca69-b469-47b4-9f68-f28b09e58a8a None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:34.671661 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca69-b469-47b4-9f68-f28b09e58a8a None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:34.671805 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35ca69-b469-47b4-9f68-f28b09e58a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:34.690422 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-aa35ca69-b469-47b4-9f68-f28b09e58a8a None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:34.691854 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-aa35ca69-b469-47b4-9f68-f28b09e58a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:34.699870 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:34.745839 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac6c7-1f0b-41a8-95ef-79ecc7092a40 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:34.763843 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ac6c7-1f0b-41a8-95ef-79ecc7092a40 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:34.769877 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:34.770702 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:34.770994 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:34.771276 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:34.781457 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:34.783294 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93410bf-b963-4291-9ff8-96a88d762355 service nova] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:34.795661 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 695/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:36.825617 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff718fc-a415-48e3-98cf-f645e495d753 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:36.826139 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff718fc-a415-48e3-98cf-f645e495d753 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:36.826262 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff718fc-a415-48e3-98cf-f645e495d753 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:36.827560 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 691/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:36.832895 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256cc1-8948-4165-9bfd-aa4f0f7f9bbf None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:36.833317 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256cc1-8948-4165-9bfd-aa4f0f7f9bbf None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:36.833460 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54256cc1-8948-4165-9bfd-aa4f0f7f9bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:36.851717 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-54256cc1-8948-4165-9bfd-aa4f0f7f9bbf None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:36.853170 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-54256cc1-8948-4165-9bfd-aa4f0f7f9bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:36.861115 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:36.906927 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff718fc-a415-48e3-98cf-f645e495d753 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:36.921594 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff718fc-a415-48e3-98cf-f645e495d753 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:36.927320 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:36.927975 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:36.928261 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:36.928607 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:36.937240 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:36.938843 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a618280-ff24-4e50-899f-d1307aabb9fa service nova] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:36.949260 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 692/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:38.799739 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05194-bc1a-4b42-a36b-31a095890b9e None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:38.800279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05194-bc1a-4b42-a36b-31a095890b9e None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:38.800279 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b05194-bc1a-4b42-a36b-31a095890b9e None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:38.801715 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 697/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:38.807146 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe730-6075-40bc-9a50-00143ad97424 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:38.807576 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe730-6075-40bc-9a50-00143ad97424 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:38.807716 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fe730-6075-40bc-9a50-00143ad97424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:38.825392 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-924fe730-6075-40bc-9a50-00143ad97424 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:38.826598 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-924fe730-6075-40bc-9a50-00143ad97424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:38.834556 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:38.890479 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c562c-237f-43ed-a1d8-07e1c73a4405 None None] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:38.890801 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c562c-237f-43ed-a1d8-07e1c73a4405 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:38.891084 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c562c-237f-43ed-a1d8-07e1c73a4405 None None] PATH_INFO: `/` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:38.892480 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 698/1391] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jun 29 23:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:38.897526 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090146b0-439a-4a42-9f5a-7c5d8c8dd4a0 None None] REQUEST_METHOD: `POST` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:38.897830 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090146b0-439a-4a42-9f5a-7c5d8c8dd4a0 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:38.898114 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090146b0-439a-4a42-9f5a-7c5d8c8dd4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:38.946214 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.auth.core [None req-090146b0-439a-4a42-9f5a-7c5d8c8dd4a0 None None] MFA Rules not processed for user `b7d1dca553bc493daf803986df6abac0`. Rule list: `[]` (Enabled: `True`). {{(pid=221126) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:38.947419 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.fernet_utils [None req-090146b0-439a-4a42-9f5a-7c5d8c8dd4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221126) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:39.007213 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 694/1392] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jun 29 23:16:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:39.014974 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c562c-237f-43ed-a1d8-07e1c73a4405 None None] Authenticating user token {{(pid=221125) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:39.027171 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c562c-237f-43ed-a1d8-07e1c73a4405 None None] Validating token access rules against request {{(pid=221125) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:39.030700 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7d1dca553bc493daf803986df6abac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221125) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:39.031344 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] REQUEST_METHOD: `GET` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:39.031631 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:39.031921 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:39.041898 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:39.043430 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09932a-00d9-457e-9e61-cd84140e44c5 service glance] RBAC: Authorization granted {{(pid=221125) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:39.053244 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 699/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:39.144367 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308557b-45ce-413a-97d6-3c6d2168f105 None None] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:39.144693 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308557b-45ce-413a-97d6-3c6d2168f105 None None] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:39.144985 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308557b-45ce-413a-97d6-3c6d2168f105 None None] PATH_INFO: `/` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:39.146390 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 695/1394] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:16:39.152128 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477b32-c45d-492b-a725-71f4f7f58e28 None None] REQUEST_METHOD: `POST` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:39.152449 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477b32-c45d-492b-a725-71f4f7f58e28 None None] SCRIPT_NAME: `/identity` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:39.152734 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92477b32-c45d-492b-a725-71f4f7f58e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=221125) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:39.170575 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.auth.core [None req-92477b32-c45d-492b-a725-71f4f7f58e28 None None] MFA Rules not processed for user `7e15b0f3d7b74d6297fef6ab4fc9c8de`. Rule list: `[]` (Enabled: `True`). {{(pid=221125) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:16:39.171765 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG keystone.common.fernet_utils [None req-92477b32-c45d-492b-a725-71f4f7f58e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=221125) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:16:39.190278 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: [pid: 221125|app: 0|req: 700/1395] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:16:39.227670 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308557b-45ce-413a-97d6-3c6d2168f105 None None] Authenticating user token {{(pid=221126) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:16:39.242555 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308557b-45ce-413a-97d6-3c6d2168f105 None None] Validating token access rules against request {{(pid=221126) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:16:39.248152 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe2c18b13963439cbe1685ce9a1f9c4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8795985765494c388bc3251da0c22cf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=221126) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:16:39.248853 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] REQUEST_METHOD: `GET` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:16:39.249137 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] SCRIPT_NAME: `/identity` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:16:39.249410 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=221126) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:16:39.259433 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:16:39.261014 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbac59-9593-414b-9fe9-60b3f8625b39 service nova] RBAC: Authorization granted {{(pid=221126) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:16:39.271812 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: [pid: 221126|app: 0|req: 696/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:16:49.165585 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: DEBUG dbcounter [-] [221125] Writing DB stats keystone:SELECT=63 {{(pid=221125) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:16:49.266889 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: DEBUG dbcounter [-] [221126] Writing DB stats keystone:SELECT=89 {{(pid=221126) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:17:00.813084 dv-cinder-812685-13-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jun 29 23:17:00.813311 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: Wed Jun 29 23:17:00 2022 - graceful shutdown triggered... Jun 29 23:17:00.813820 dv-cinder-812685-13-iscsi devstack@keystone.service[221125]: Gracefully killing worker 1 (pid: 221125)... Jun 29 23:17:00.814203 dv-cinder-812685-13-iscsi devstack@keystone.service[221126]: Gracefully killing worker 2 (pid: 221126)... Jun 29 23:17:01.813877 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: worker 1 buried after 1 seconds Jun 29 23:17:01.814318 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: worker 2 buried after 1 seconds Jun 29 23:17:01.814318 dv-cinder-812685-13-iscsi devstack@keystone.service[221113]: goodbye to uWSGI. Jun 29 23:17:01.815431 dv-cinder-812685-13-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jun 29 23:17:01.815981 dv-cinder-812685-13-iscsi systemd[1]: Stopped Devstack devstack@keystone.service. Jun 29 23:22:22.964780 dv-cinder-812685-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 29 23:22:22.974305 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 23:22:22 2022] *** Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: nodename: dv-cinder-812685-13-iscsi Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: machine: x86_64 Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: clock source: unix Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: pcre jit disabled Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: detected number of CPU cores: 4 Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: current working directory: / Jun 29 23:22:22.976292 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: detected binary path: /usr/bin/uwsgi-core Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: your processes number limit is 47680 Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: your memory page size is 4096 bytes Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: detected max file descriptor number: 2048 Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: lock engine: pthread robust mutexes Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: thunder lock: enabled Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 29 23:22:22.977063 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 23:22:23.021141 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: Python main interpreter initialized at 0x55ecb3a769c0 Jun 29 23:22:23.021141 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: python threads support enabled Jun 29 23:22:23.021141 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: your server socket listen backlog is limited to 100 connections Jun 29 23:22:23.021141 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: your mercy for graceful operations on workers is 90 seconds Jun 29 23:22:23.021559 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 23:22:23.021559 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: *** Operational MODE: preforking *** Jun 29 23:22:23.021809 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: *** uWSGI is running in multiple interpreter mode *** Jun 29 23:22:23.021809 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: spawned uWSGI master process (pid: 285920) Jun 29 23:22:23.022005 dv-cinder-812685-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 29 23:22:23.022855 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: spawned uWSGI worker 1 (pid: 285931, cores: 1) Jun 29 23:22:23.023002 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: spawned uWSGI worker 2 (pid: 285932, cores: 1) Jun 29 23:22:23.025098 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 23:22:28.474389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:22:28.474389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: from cryptography.utils import int_from_bytes Jun 29 23:22:28.475276 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:22:28.475276 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: from cryptography.utils import int_from_bytes Jun 29 23:22:28.476055 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:22:28.476055 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: from cryptography.utils import int_from_bytes Jun 29 23:22:28.476627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 23:22:28.476627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: from cryptography.utils import int_from_bytes Jun 29 23:22:28.523726 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 23:22:28.523921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 23:22:28.524101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] command line args: [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 23:22:28.525277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 23:22:28.525479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 23:22:28.525585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 23:22:28.525683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] command line args: [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 23:22:28.525800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ================================================================================ {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 23:22:28.525951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] admin_token = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.526208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] config_dir = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.526401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.526591 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] config_source = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.526778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] debug = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.526982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.527283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 23:22:28.527283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ================================================================================ {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 23:22:28.527441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.527524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] admin_token = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.527613 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] insecure_debug = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.527783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] config_dir = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.527911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528160 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] config_source = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] debug = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528742 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_config_append = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.528883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529328 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_dir = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] insecure_debug = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_file = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529735 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.529864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530306 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530445 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_config_append = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.530937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_dir = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_file = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531794 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.531894 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532298 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.532992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533088 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] notification_format = cadf {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] publish_errors = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.533961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] notification_format = cadf {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] standard_threads = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.534946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] publish_errors = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] strict_password_check = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535241 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] use_eventlog = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] use_journal = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] use_json = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.535922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] use_stderr = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] use_syslog = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536260 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] standard_threads = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] watch_log_file = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536476 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] strict_password_check = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.536671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] use_eventlog = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.536855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.536945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] use_journal = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.537039 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.537140 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] use_json = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.537140 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] use_stderr = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.537349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.537446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] use_syslog = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.537542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.537637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] watch_log_file = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 23:22:28.537740 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.537837 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.537937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538415 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.538972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539447 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.539959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540249 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.540943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541837 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.541942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542327 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.542930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.543064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.543168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.543294 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.543390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.543561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544313 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544457 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.544985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.545930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.546939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547091 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547325 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.547865 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548274 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548841 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.548944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549662 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549764 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.549901 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550006 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550373 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.550942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551313 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551547 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.551889 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552365 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.552872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553232 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553577 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.553949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.enabled = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554304 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554542 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554678 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.554914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555253 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555494 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555620 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.enabled = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.555963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.556952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.557885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558588 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.558958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.559080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.559187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.559923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560458 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.560918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.external = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.561957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.mapped = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562090 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.password = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562705 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] auth.token = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.562949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.external = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563176 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.mapped = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] catalog.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.563898 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.password = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] auth.token = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564537 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] catalog.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.564877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.565980 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566718 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.566961 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.567851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.568873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569740 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.569991 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.570969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571204 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.571932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.572902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573001 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573482 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573835 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.573931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574072 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574177 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.574888 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575412 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575542 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.575879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.576863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577342 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577621 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.577958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578301 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.578901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.579938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.password = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580699 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.580921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581773 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.password = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.581877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582707 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.582945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583639 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583742 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.583988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.584969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585440 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.585898 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586742 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.586978 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587447 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587558 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.587928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588264 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588419 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.588903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589487 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.589964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] policy.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.590945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] receipt.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591655 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.591908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] policy.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592362 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] receipt.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.592865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593010 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593257 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593365 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593727 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.593965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] revoke.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594454 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.594928 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] role.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] role.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] role.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] role.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] revoke.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.595975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] role.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596487 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] role.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.596973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] role.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] role.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597344 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597591 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.597930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598568 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.598915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599062 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599545 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.599953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600747 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.600995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601145 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601242 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601642 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.601973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.602953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603090 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.603889 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604229 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.provider = fernet {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.604950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605140 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605342 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605438 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.provider = fernet {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605874 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.605972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] trust.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.606651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.606768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.606905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607004 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.607969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] trust.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608349 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.connection = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.608967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609110 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609342 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609581 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609684 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.609930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.connection = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.610883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611633 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611732 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.611961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612454 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.612939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.613036 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.613126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=285932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 23:22:28.613215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.613410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.613657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.613891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.614141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.614382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 23:22:28.614556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=285931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 23:22:28.642605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.642834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.642944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.643060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.643166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.643269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.651653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.651797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.680326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.680590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.680706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.680931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.823124 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.823488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.872371 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.872623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.872769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.872868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.938235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.938463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.938689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.938820 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.938924 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939549 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.939767 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.961853 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962344 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962633 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962835 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.962933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.963024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.963128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.963221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.974667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.974887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.987612 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.987842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.987955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988275 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.988915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.989020 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=285931) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:28.989112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=285932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 29 23:22:29.005836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.006045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:22:29.006385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.006508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.006617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:22:29.006716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:22:29.006916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007082 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 29 23:22:29.007351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007718 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.007986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.008124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.008384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.019366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.019643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.019914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.020022 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.020191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.020291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.020482 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.020764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.028824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.029383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.032180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.032557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.032758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.032858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033578 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.033964 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034123 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034661 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.034927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.035028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.035200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.035467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.061184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.061832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.062790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.063068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.063440 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.063726 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.068284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.068587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.068870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.068981 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.069227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.069505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.076916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.077152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.077443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.077728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.081622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.081913 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.082187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.082302 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.082470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.082577 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.082746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.082853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083136 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083400 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.083833 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.084102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.102717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.103004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.103158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.103439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.107688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.108032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.111340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.111637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.111750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.111945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.116768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.117107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.120366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.120735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.124092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.124392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.124516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.124708 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.124868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.125842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.145300 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.145539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.145653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.145823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.145938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.146089 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.146196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.146352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.154485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.154778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.156214 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.156522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.156623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.156801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.159635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.159843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.159952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.160126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.161706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.161836 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.161999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.162131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.162302 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.162436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.175604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.175716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.175886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.175993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.176878 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.177038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.177149 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.177311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.177419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.195126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.195254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.198408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.198514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.202224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.202334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.203817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.203931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.205626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.205735 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.205907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.206019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.206192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.206301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.213491 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.213608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.215099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.215199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.218867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.218998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.219834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.228878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.229005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.229163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.229278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.229444 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.229544 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.237319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=285932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.237432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=285931) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 29 23:22:29.237598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.237704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.237881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.237990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.238972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239619 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.239990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.240959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=285932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.241071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=285931) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 29 23:22:29.279563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ecb3a769c0 pid: 285932 (default app) Jun 29 23:22:29.279695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ecb3a769c0 pid: 285931 (default app) Jun 29 23:22:29.282948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dce49-6279-4877-998f-c5e348970f48 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:29.283254 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dce49-6279-4877-998f-c5e348970f48 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:29.283534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64dce49-6279-4877-998f-c5e348970f48 None None] PATH_INFO: `/v3` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:29.287733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Wed Jun 29 23:22:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:37.642910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:37.643523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:37.643523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:37.647784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:22:37.653865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:37.654299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:37.654438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:37.724490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: INFO dbcounter [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] Registered counter for database keystone Jun 29 23:22:37.745952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG oslo_db.sqlalchemy.engines [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=285932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 23:22:37.752340 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writer thread running {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 23:22:37.943199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG passlib.handlers.bcrypt [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=285932) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 23:22:37.943199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG passlib.handlers.bcrypt [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=285932) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 23:22:37.988687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:37.990319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:38.114970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 23:22:38.139014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:38.209617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: INFO dbcounter [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] Registered counter for database keystone Jun 29 23:22:38.229033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG oslo_db.sqlalchemy.engines [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=285931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 23:22:38.235219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writer thread running {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 23:22:38.353460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69098af-edfc-429e-8467-aa8d580f3f5f None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:38.357982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ad7aca62a34f47abfc76d765429cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:38.358659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:38.358951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:38.359238 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:38.367573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:38.420494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 23:22:38.420842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e993fe-bfd4-45f1-b980-368f803dbce4 admin admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:38.430793 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 23:22:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 29 23:22:38.437326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:38.454474 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb838e-b266-467b-ae36-d7c472fe8ca2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:38.458927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ad7aca62a34f47abfc76d765429cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:38.460090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:38.460332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:38.460643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] PATH_INFO: `/v3/projects/18ad7aca62a34f47abfc76d765429cb6` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:38.462164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=18ad7aca62a34f47abfc76d765429cb6)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:38.512289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: WARNING keystone.common.rbac_enforcer.enforcer [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 29 23:22:38.513231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20288a-3192-441a-b127-4fad79d84dc5 admin admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:38.517841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Wed Jun 29 23:22:38 2022] GET /identity/v3/projects/18ad7aca62a34f47abfc76d765429cb6 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:40.531237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa23cc-8d5f-4121-bff0-692618d1b0b2 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:40.531768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa23cc-8d5f-4121-bff0-692618d1b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:40.531768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa23cc-8d5f-4121-bff0-692618d1b0b2 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:40.535838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:40.541273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:40.541700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:40.541846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:40.561635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:40.563171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:40.571087 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 29 23:22:40.593270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa23cc-8d5f-4121-bff0-692618d1b0b2 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:40.605412 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa23cc-8d5f-4121-bff0-692618d1b0b2 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:40.610307 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ad7aca62a34f47abfc76d765429cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:40.610950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:40.611245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:40.611535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:40.619323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:40.621157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8760-b8c4-4278-be46-8957b72ad901 admin admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:40.630635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Wed Jun 29 23:22:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 29 23:22:40.635972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:40.644894 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c4123-2753-494f-bd98-3edcda12c878 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:40.649394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18ad7aca62a34f47abfc76d765429cb6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:40.650255 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:40.650546 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:40.650830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:40.652231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:40.654671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0482f1-c006-4990-968c-1dd27a36c636 admin admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:40.656229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Wed Jun 29 23:22:40 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:42.757053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77031f-eadc-435c-9d0d-4d8caaec500c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:42.757625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77031f-eadc-435c-9d0d-4d8caaec500c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:42.757625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77031f-eadc-435c-9d0d-4d8caaec500c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:42.759006 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:42.764988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:42.765435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:42.765674 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:42.782742 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:42.783913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:42.788950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aa1f-78b4-4aeb-88f3-ac479e734fd5 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:42.789250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aa1f-78b4-4aeb-88f3-ac479e734fd5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:42.789540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642aa1f-78b4-4aeb-88f3-ac479e734fd5 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:42.790888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:22:42.795797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:42.796094 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:42.796386 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:42.836045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG passlib.handlers.bcrypt [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=285931) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 29 23:22:42.836504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG passlib.handlers.bcrypt [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=285931) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 29 23:22:42.866501 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:42.882434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:42.884050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:42.891009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:42.914774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:42.984130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:22:42.995452 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36526927-2fe4-4e8c-873f-810334fd4e94 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.006967 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.030120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.030858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.031150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.031437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.042572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:43.053858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:43.055207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:22:43.056313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:22:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:22:43.061315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.108772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09945a28-609a-4cbb-a90a-4c37d5d5845a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.111100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.147194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.148105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.148421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.148711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.150117 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.168260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b30801-35ac-4089-920d-5f3920ecbadb None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.203709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.204385 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.204710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.204996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.205774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:43.206071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.207484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.216570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.218111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.219100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:43.224583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.315884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:22:43.321600 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.324746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.328377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633b75e-7b1d-42b8-9f6d-d6b069469e4e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.362299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.363179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.363466 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.363748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.365024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.366503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.368146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:43.374056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.388150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.422163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb0a4-6d0f-4f9b-8d62-433d0d5c4709 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.457122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.457941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.458236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.458526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.471250 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3768-77be-4656-88cf-01ec2f5ec488 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.476664 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.478144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:22:43.500259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:43.501389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:43.502450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:22:43.502450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:22:43.502450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:22:43.502450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:22:43.502450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:22:43.507348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.507949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.508798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.509092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.509380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.510848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.512320 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.514040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:43.519581 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:43.563637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.599690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:43.605918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1b5c3-cfd2-41fd-939c-5fbcb8818661 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.618595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e79ad9-3faa-45c5-a497-a11b40ad6b98 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:43.641790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.642467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.642758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.643055 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.643786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:43.644098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.645534 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d00a76-8150-4e6b-89fb-be332e4b6529 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.652373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:43.653565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:43.653854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:43.654136 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:43.654964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.domain.id=default, user.id=28f47b2146194815a01965579698893d) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:43.655277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:43.656748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448de6-0729-4326-9ccf-3381c09f4664 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:43.663538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:43.663694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 23:22:43 2022] GET /identity/v3/role_assignments?user.id=28f47b2146194815a01965579698893d&scope.domain.id=default&role.id=d47785af145640e9b0d7553f25d48899 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:46.050060 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0668b-071d-4b1a-80a5-2d1bd512bf00 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.050639 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0668b-071d-4b1a-80a5-2d1bd512bf00 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.050639 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0668b-071d-4b1a-80a5-2d1bd512bf00 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.052259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:46.057222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.057646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.057806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.081563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:46.082768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:46.189193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 12/23] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:46.221509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0668b-071d-4b1a-80a5-2d1bd512bf00 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:46.386848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0668b-071d-4b1a-80a5-2d1bd512bf00 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:46.408923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:46.431898 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:46.433873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.433873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.433873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.451085 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-226ddd1b-baf8-4009-994b-b9d477a66338 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:46.463632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:46.464917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:22:46.466603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 12/24] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:46.474007 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:46.584005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:46.626919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13921-8131-44c2-b936-4f5cbe5516c7 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:46.645484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133cd15-ee5f-40f4-9008-09ada0c73aad None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.646122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133cd15-ee5f-40f4-9008-09ada0c73aad None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.646651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133cd15-ee5f-40f4-9008-09ada0c73aad None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.648256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 13/25] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:46.653651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2764e-524b-4cdb-b426-7762462d6d06 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.654237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2764e-524b-4cdb-b426-7762462d6d06 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.654760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2764e-524b-4cdb-b426-7762462d6d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.698334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-a1a2764e-524b-4cdb-b426-7762462d6d06 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:46.701241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-a1a2764e-524b-4cdb-b426-7762462d6d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:46.713122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:46.714159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.714668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.715179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.716286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:46.716908 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:46.718564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5b00e-75b3-4954-8fc5-a74f7cf4bad3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:46.731896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 13/26] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:46.738657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82445-1637-4b32-a539-8f2c9e3f652a None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.740040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82445-1637-4b32-a539-8f2c9e3f652a None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.740748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82445-1637-4b32-a539-8f2c9e3f652a None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.743600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:46.749102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82445-1637-4b32-a539-8f2c9e3f652a None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:46.801129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:22:46.809095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.822800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.822800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.841045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:46.842762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:46.865575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82445-1637-4b32-a539-8f2c9e3f652a None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:46.911956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:46.913378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.913841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.914651 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.916367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:46.918908 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7eb07-ea1e-49a6-937f-9a406a1f0339 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:46.920753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 15/29] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:46 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:46.922190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff128-5f3f-46be-8787-19e418a848f8 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:46.922647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff128-5f3f-46be-8787-19e418a848f8 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:46.923075 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff128-5f3f-46be-8787-19e418a848f8 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:46.924722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:46.926881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 15/31] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:46.928067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:46.929484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ff128-5f3f-46be-8787-19e418a848f8 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:46.935026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:46.969162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:47.047710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f16343-8777-4c23-a6a5-33250fd3ef70 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:47.069873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ff128-5f3f-46be-8787-19e418a848f8 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:47.086161 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:47.087608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.088093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.090452 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:47.092221 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c00dbd6-0aee-4520-a0c1-ad6b29e2d49c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:47.094983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:47.096486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.097021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.097523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.119626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:47.120695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.121227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.121727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.122485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:47.123438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:47.123616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:47.125460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:47.196630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:47.197430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:47.233630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:47.300568 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0802a3-4cc4-4c81-8231-63803bc81822 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:47.340434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:22:46 2022] POST /identity/v3/roles => generated 219 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:47.340434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:47.344396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:47.345208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.345577 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.345968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.347005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:47.348655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c91d96-c97c-4b19-9675-641f2cdd3615 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:47.416027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:47.462005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e464a9-ab8b-475d-b686-5520abcd7b60 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:47.501760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:47.502832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.503230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.503527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] PATH_INFO: `/v3/domains/default/users/28f47b2146194815a01965579698893d/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.506557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=28f47b2146194815a01965579698893d, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:47.508178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9acdf7d-1cc4-4310-9098-cf6bf9a52225 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:47.561792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:22:47 2022] POST /identity/v3/roles => generated 225 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:47.563348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9d92-d377-42a2-a41e-43f81c16209d None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.563653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9d92-d377-42a2-a41e-43f81c16209d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.563946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d9d92-d377-42a2-a41e-43f81c16209d None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.565550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:47.566292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9d92-d377-42a2-a41e-43f81c16209d None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:47.587587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 18/37] 10.222.0.16 () {58 vars in 1361 bytes} [Wed Jun 29 23:22:47 2022] PUT /identity/v3/domains/default/users/28f47b2146194815a01965579698893d/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:22:47.590410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.591142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.591675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.706180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:47.715320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d9d92-d377-42a2-a41e-43f81c16209d None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:47.738078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:47.740435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:47.758258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:47.759098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.759392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.759676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.775323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:47.777043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-aef3b7ca-f187-439a-b402-8793a969471d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:22:47.799192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:47.800325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:47.801407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:22:47.801407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:22:47.801407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:22:47.801407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:22:47.801407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:47.801769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71115a-f4b3-4691-b8d2-07ecb31409a5 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.802500 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71115a-f4b3-4691-b8d2-07ecb31409a5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.802500 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71115a-f4b3-4691-b8d2-07ecb31409a5 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.803581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:47.810230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:47.810570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:47.810811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:47.831738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:47.833361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:47.834341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:47.835218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:47.913661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:47.922550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:47.923478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:47.971883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c9109-2d26-48eb-a14b-1554725babde None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:48.011501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:48.011900 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:48.013202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:48.013734 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:48.014232 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:48.015047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:48.015364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:48.016802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:48.034877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 20/42] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:48.036148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f4f38-c4cc-426b-9af0-0f26344a8e38 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:48.040047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:48.075516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:48.076200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:48.076524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:48.076812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:48.077566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:48.078974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:48.134915 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 23/43] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:22:47 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:48.136163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:48.156444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2f95-a167-449d-8313-bbfcf9c1275d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:48.176690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:48.207819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:48.209670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:48.210479 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:48.210984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:48.213353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:48.215143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:48.218431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 21/44] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:48.225076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:48.274852 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474bd93-10a0-467c-b29d-fc02b5d0b794 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:48.315263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:48.316095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:48.316513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:48.316879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:48.317628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:48.319178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087187e-99e1-47f7-9111-b8709fea68aa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:48.324164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:48.347413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663a9e4-c596-4e27-8119-bd306cd06848 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:48.385084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:48.386079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:48.386378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:48.386687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:48.387449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:48.388967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ab763-6122-4cf7-9051-7e606a23c12d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:48.405849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 24/45] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:22:48 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:48.480062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:22:48 2022] POST /identity/v3/projects => generated 312 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:49.709327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490816d-c86a-41c8-99e5-b7092265a9ab None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:49.709895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490816d-c86a-41c8-99e5-b7092265a9ab None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:49.709895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490816d-c86a-41c8-99e5-b7092265a9ab None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:49.711280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:49.716586 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:49.716973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:49.717289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:49.733925 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:49.735128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:49.761579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:49.800205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:49.823785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490816d-c86a-41c8-99e5-b7092265a9ab None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.032939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490816d-c86a-41c8-99e5-b7092265a9ab None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.065785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.066594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.066886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.067169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.077877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:50.085596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:50.086854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:22:50.088074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:50.096615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.193665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1038f-197e-490f-98d5-7b7e91f00365 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.227230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.227913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.228206 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.228515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.229280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:50.229593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.231002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:50.239656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:50.245152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.294398 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:50.344695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe79e93-5615-4a8b-987b-235c638fe907 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.378751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227b791-5025-44b4-b698-26e56492478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.379640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b791-5025-44b4-b698-26e56492478b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.379928 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b791-5025-44b4-b698-26e56492478b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.380207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227b791-5025-44b4-b698-26e56492478b None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.381688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227b791-5025-44b4-b698-26e56492478b None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.383171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227b791-5025-44b4-b698-26e56492478b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:50.384872 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 27/51] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:50 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:50.391199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.418607 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:50.489621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f4914-1a3c-434d-abd0-b059eb6a1111 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.524042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.524895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.525191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.525476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.526691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.528199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17469c1a-fa40-4eab-afa7-c1d6953d716c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:50.529885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 25/52] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:50.535760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227b791-5025-44b4-b698-26e56492478b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.544826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9b48-7749-4212-a1ff-5852ba3a0ac8 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.545066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9b48-7749-4212-a1ff-5852ba3a0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.545361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef9b48-7749-4212-a1ff-5852ba3a0ac8 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.546703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 26/53] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:22:50.551542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.551833 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.552119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.568692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:50.569881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:50.635003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 27/54] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:22:50.636572 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227b791-5025-44b4-b698-26e56492478b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.653734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:50.659905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.671726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.672419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.672716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.672999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.673839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.domain.id=default, user.id=28f47b2146194815a01965579698893d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:50.674156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.675626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:50.684009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:50.684296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Wed Jun 29 23:22:50 2022] GET /identity/v3/role_assignments?user.id=28f47b2146194815a01965579698893d&scope.domain.id=default&role.id=d47785af145640e9b0d7553f25d48899 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:50.770519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde933e-b96f-4db6-ab69-92eeec6a48d7 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.806728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.807472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.807770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.808061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.809425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.810938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998f22e-e26d-4c66-b1ff-c48328ffe7e4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:50.812842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:50.818425 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:50.922112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b85a9-f197-4786-8fa8-1018dd9a031a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:50.954883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:50.955580 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:50.955921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:50.956150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:50.956912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:50.958378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e65d0b-2722-413d-8421-23d7024475cb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:51.060712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 23:22:50 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:53.079501 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4ce9-5a03-4563-a8f4-d131f5fce36a None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:53.080084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4ce9-5a03-4563-a8f4-d131f5fce36a None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:53.080084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e4ce9-5a03-4563-a8f4-d131f5fce36a None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:53.081523 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:53.086558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:53.086966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:53.087139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:53.104368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:53.105628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:53.130938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:53.173724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:53.198219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e4ce9-5a03-4563-a8f4-d131f5fce36a None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:53.293568 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:53.302813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e4ce9-5a03-4563-a8f4-d131f5fce36a None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:53.336315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:53.337087 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:53.337384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:53.337671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:53.338873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:53.340337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cdfda-3345-4487-b4ca-2cd12d543380 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:53.342535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:53.348031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:53.444987 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb96858-0165-4943-a55d-095e5a268bc8 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:53.478108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:53.478782 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:53.479080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:53.479369 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:53.480099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:53.481618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6557d2-c983-45f7-a196-fcfcb4ae50bd None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:53.556151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:22:53 2022] POST /identity/v3/users => generated 275 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:22:56.585801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659bee-9dcd-41f3-9e93-5f2974b58e1b None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:56.585801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659bee-9dcd-41f3-9e93-5f2974b58e1b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:56.585801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96659bee-9dcd-41f3-9e93-5f2974b58e1b None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:56.586958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:56.593096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae3fc5-9dba-4a8c-976b-8395aac11a93 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:56.593962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae3fc5-9dba-4a8c-976b-8395aac11a93 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:56.594521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae3fc5-9dba-4a8c-976b-8395aac11a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:56.621406 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-40ae3fc5-9dba-4a8c-976b-8395aac11a93 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:56.623445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-40ae3fc5-9dba-4a8c-976b-8395aac11a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:56.643008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:56.711690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:56.748003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96659bee-9dcd-41f3-9e93-5f2974b58e1b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:56.834657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075028-03f0-45eb-901b-b3ea03ad3e82 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:56.835023 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075028-03f0-45eb-901b-b3ea03ad3e82 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:56.835237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74075028-03f0-45eb-901b-b3ea03ad3e82 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:56.836737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 33/64] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:56.842137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:56.842738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:56.843257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:56.861678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:56.863652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:56.903941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96659bee-9dcd-41f3-9e93-5f2974b58e1b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:56.962877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:22:56.982613 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:56.986704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:56.986704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:56.986704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:56.995436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:56.998768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:57.007266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:57.008367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:22:57.009677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:22:57.012346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 32/66] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:57.022789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.080789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.152792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.190699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e6fc4-2e84-44c6-a023-6f9d6bac8238 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.224003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f558-b9da-4761-b7fb-f3fdb8d56933 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.234288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.235114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.235410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.235799 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.247391 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-09ca9880-91d9-44ea-b69b-9c37e50ba08c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:57.255747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:57.256910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:22:57.257900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 35/67] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:57.258732 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb6f-68b5-4906-ae11-bc6170bc968d None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.258825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb6f-68b5-4906-ae11-bc6170bc968d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.259740 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539feb6f-68b5-4906-ae11-bc6170bc968d None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.260597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 36/68] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:57.262708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.263395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.263685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.263971 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.264768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:57.265085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.266292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.266771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:57.266951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.266951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.276391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 33/69] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:57.277252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.290236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:57.291570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:57.365548 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 37/70] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:57.366329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.374738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.394532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095023d-18c4-496c-8524-f13ee42ae4b7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.429373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.430058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.430352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.430643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.431401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:57.431719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.433166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f1a58-0ef8-4044-884d-ce71252b845b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:57.435029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.441260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 34/71] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:57.442571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a56d-a7ce-4dc2-a256-28b7975620ed None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.442876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a56d-a7ce-4dc2-a256-28b7975620ed None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.443165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153a56d-a7ce-4dc2-a256-28b7975620ed None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.444690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 35/72] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:57.446086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c30b-fd8a-47cc-9e66-0ac90d4fb04a None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.446086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c30b-fd8a-47cc-9e66-0ac90d4fb04a None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.446086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371c30b-fd8a-47cc-9e66-0ac90d4fb04a None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.447305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 36/73] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:22:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:22:57.448570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371c30b-fd8a-47cc-9e66-0ac90d4fb04a None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.474478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546876a-d872-44c2-a911-6366d7a86979 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.508336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.509257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.509550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.509842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.525589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.527078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:57.529405 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:57.530187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.553632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371c30b-fd8a-47cc-9e66-0ac90d4fb04a None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.587089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.587901 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.588191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.588511 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.599295 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-2f5906cc-5e01-4555-976c-2d2df1bb8366 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:57.607703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:57.608849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:57.614967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.616050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.616050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.618353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.628027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d457d8e-4669-45e0-8dfd-361b2053eda4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.628703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:57.629916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:57.655188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.663481 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.664376 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.664709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.664999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.666237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.667719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4b8a7-2206-4a65-b736-06e41f857fa8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:57.669414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:57.670587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.670891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.671168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.687666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:22:57.688948 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:22:57.701792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:57.702719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.763517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 40/78] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:22:57.772656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.811243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce50cc6-67ca-434d-ab02-2207d3652e2e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.845236 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.845893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.846185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.846473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.849147 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.864193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c93af0-56a2-4e46-867e-9d67b2a3f2fe None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:57.888284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:57.898916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:57.899596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:57.899887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:57.900171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:57.900955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:57.901273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.902673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:57.914389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:57.915193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:57.918023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:57.919696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.017088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3e9aa-3ea0-4b1d-9a4f-0aeb681e1228 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.019976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 39/80] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:22:58.020855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.051495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.052155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.052479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.052769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.053927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.108209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.122196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.122928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbadeb-f9ca-4415-af9a-3e02878ad1d5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.123718 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.157081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.157827 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.158116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.158399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.168467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:22:58.176109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:22:58.177354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:22:58.178769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.227067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 42/82] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:22:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:22:58.229295 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.272109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.278449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2abb42-758f-4e64-919a-e297b8b9465a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.312948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.313756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.314050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.314338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.315536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.315808 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.317074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.318862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.319475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.337413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df59643-7fa0-4ce2-a8b6-0307059c1d03 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.374122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.375042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.375333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.375614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.376869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.378334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.379973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 43/84] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.380767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.420120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48715e7-ec8f-4add-a4a4-6639efa27308 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.453944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.454821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.455112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.455402 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.456639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.458109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.459991 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 42/85] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.460627 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.484069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19ef2-b096-4d86-999d-34076e9d27f6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.490012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.518149 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.518925 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.519282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.519572 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.520428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:58.520660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.522114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.530078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 44/86] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.532569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.549231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.559881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe1a09-8304-40ab-93e8-cdc3edf1f195 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.593146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.594017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.594306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.594588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.595775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.597282 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.599011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 43/87] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.599782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.631325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7171b-d204-403b-a47b-f8ed5a57e84c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.665009 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.665691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.665983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.666264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.666977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.668442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.698774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.702458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b301-a30f-434c-80ac-f4657370db31 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.735837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.736522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.736823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.737116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.801802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.803298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.819422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 45/88] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:22:58 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:22:58.820151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.903403 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.926439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:58.931489 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 44/89] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:22:58.931489 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:58.944032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4573655-d116-42a0-974a-21aad0ba06b7 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:58.984308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:58.985095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:58.985388 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:58.985672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:58.986519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:58.986835 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:58.988322 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:58.996703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=9c32a0917e444135870b906aa819927d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:58.997194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:59.076099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be217195-533e-4616-92d2-4c157c4549c1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.133832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.134866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.135165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.135446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.137089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.139208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.139720 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023111a-6d26-4cc0-a141-ac0ba3e3879d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.141060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:59.144429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:59.188439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.189144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.189440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.189731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.190638 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=28f47b2146194815a01965579698893d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:59.190992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.192470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.195644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:59.198576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:22:58 2022] GET /identity/v3/role_assignments?user.id=28f47b2146194815a01965579698893d&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:59.201354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:59.264878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:59.340112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb741b6-2e22-4da8-908c-eb8f995a9018 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.388621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.389521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.389813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.390100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.391347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.392970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.394903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:22:59 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:59.401088 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:59.426152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000262da-6ba5-4b7a-9f4c-e7db016930cd None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.485983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.486677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.486975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.487274 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.521255 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2b114-d341-4cd0-b627-32f4dab15c90 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.563126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.563853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.564153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.564673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.565530 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:22:59.565855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.569405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.576741 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:59.581341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 47/94] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:22:59 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:22:59.621205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.623278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.625519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:22:59.771359 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 48/95] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:22:59.777172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:22:59.917871 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f87cb9-0d0d-4b3f-be78-2b409e27315e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:22:59.953583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:22:59.954476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:22:59.954769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:22:59.955054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] PATH_INFO: `/v3/projects/24e36ca547f74a2aa14d4740331161eb` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:22:59.956274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] RBAC: Authorizing `identity:get_project(project_id=24e36ca547f74a2aa14d4740331161eb)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:22:59.957782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6baa8b4-4630-4b28-97c4-48821ac0de78 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:22:59.959517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 48/96] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:22:59 2022] GET /identity/v3/projects/24e36ca547f74a2aa14d4740331161eb => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:22:59.965516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:00.122317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:00.125997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12120599-5779-4174-a436-8bbb35f5b62b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:00.181116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:00.181804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:00.182101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:00.182385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:00.183236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=24e36ca547f74a2aa14d4740331161eb, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:00.183560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:00.185082 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b177-58a0-4b66-ba28-b932d024aaca None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:00.191479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 49/97] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:22:59 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=24e36ca547f74a2aa14d4740331161eb&role.id=9c32a0917e444135870b906aa819927d => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:01.591835 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8738f4-17d2-4ee5-b435-2436a583f155 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.592962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8738f4-17d2-4ee5-b435-2436a583f155 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.593505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8738f4-17d2-4ee5-b435-2436a583f155 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.595393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 49/98] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:01.601094 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d107e-db87-4606-92c9-771e9fa68f86 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.601978 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d107e-db87-4606-92c9-771e9fa68f86 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.602497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d107e-db87-4606-92c9-771e9fa68f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.626869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-be2d107e-db87-4606-92c9-771e9fa68f86 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:01.628475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-be2d107e-db87-4606-92c9-771e9fa68f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:01.717778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:01.754385 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8738f4-17d2-4ee5-b435-2436a583f155 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:01.827268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f85c-647d-404d-9881-2e31cc9c8cad None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.827972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f85c-647d-404d-9881-2e31cc9c8cad None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.828548 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f85c-647d-404d-9881-2e31cc9c8cad None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.830196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:01.835470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f49a-5df5-45bc-9159-63a97bb13259 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.836044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f49a-5df5-45bc-9159-63a97bb13259 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.836599 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63f49a-5df5-45bc-9159-63a97bb13259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.844252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:01.873550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-bb63f49a-5df5-45bc-9159-63a97bb13259 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:01.875180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-bb63f49a-5df5-45bc-9159-63a97bb13259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:01.882527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8738f4-17d2-4ee5-b435-2436a583f155 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:01.952557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:01.960464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.960464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.960464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.971348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d9cc8b8f-47c4-4a08-b965-c1281d7b8352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:01.979541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:01.981065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:01.982845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:01.985637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 50/101] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:01.991018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98cab-56ad-47de-b9d5-2cfe6eb7d19b None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:01.991317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98cab-56ad-47de-b9d5-2cfe6eb7d19b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:01.991610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f98cab-56ad-47de-b9d5-2cfe6eb7d19b None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:01.993065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 51/102] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:01.995133 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98cab-56ad-47de-b9d5-2cfe6eb7d19b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.009827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 52/103] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:02.011414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.011720 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.012011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.046282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:02.047487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:02.087410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.151080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 53/104] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:02.151973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.206050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f98cab-56ad-47de-b9d5-2cfe6eb7d19b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.263202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.280995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.281764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.282058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.282338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.283104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:02.283413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:02.284858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:02.298618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 52/105] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:02.299287 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.316929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433746-d5b4-4466-8d1b-a689e2b79b7c None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.365784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.366516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.366806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.367087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.368435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:02.369904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:02.372296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:02.378520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.419501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.506386 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3132b-5f88-4fb0-a987-42fab1ffc528 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.546331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b21bb1-f176-4ede-af7b-6751c56e9e47 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.549348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.550332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.550620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.550906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] PATH_INFO: `/v3/users/6d76971d245448cc8e57176c4fbeca98` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.580597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] RBAC: Authorizing `identity:get_user(user_id=6d76971d245448cc8e57176c4fbeca98)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:02.582102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:02.588187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 55/107] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:02 2022] GET /identity/v3/users/6d76971d245448cc8e57176c4fbeca98 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:02.589013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.620729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.623203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.623506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.623791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.641901 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:02.650930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:02.652204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:02.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:02.655683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 53/108] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:02.656688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:02.713492 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.770788 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a893-09ea-4c8c-b03c-baf47f0b735d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.809006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.811658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.812129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.812659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.838277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942a46-0c0a-4fff-94eb-702567366b8a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:02.890880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:02.892583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:02.928667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:02.929465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:02.929767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:02.930059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:02.930787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:02.932259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6063b84-5ead-465a-9d31-124df62b69c2 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:02.944317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:02.995618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 54/109] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:02.996659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 56/110] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:23:02 2022] POST /identity/v3/projects => generated 302 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33896b-adca-4b42-9996-ae88ee82867d None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33896b-adca-4b42-9996-ae88ee82867d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33896b-adca-4b42-9996-ae88ee82867d None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 57/111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0cd6-52c6-4f5a-abf1-0c477fe55c50 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.018496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0cd6-52c6-4f5a-abf1-0c477fe55c50 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.019339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a0cd6-52c6-4f5a-abf1-0c477fe55c50 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.019339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:03.019504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0cd6-52c6-4f5a-abf1-0c477fe55c50 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.139417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc22-eef5-414d-a3db-0e88d8d0c165 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.165073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a0cd6-52c6-4f5a-abf1-0c477fe55c50 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.176972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.177675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.177969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.178258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.179028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:03.179346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:03.180794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ce7e1-85d8-464c-be62-33c49ac9c832 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:03.189582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 55/113] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:03.190857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563521-0078-46f1-9e65-88ba10505a76 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.191153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563521-0078-46f1-9e65-88ba10505a76 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.191435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c563521-0078-46f1-9e65-88ba10505a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.205326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.207896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-6c563521-0078-46f1-9e65-88ba10505a76 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:03.209115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-6c563521-0078-46f1-9e65-88ba10505a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:03.211631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.211954 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.212710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.213013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.213285 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.214762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:03.216788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8007607-37ab-49a8-833a-17cc590b71a7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:03.218696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 59/114] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:03.219850 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.220131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.220432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.238650 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:03.240135 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:03.292546 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 56/115] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:03.295720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed3b1-d09c-4682-b17d-99da8b7b1a65 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.296283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed3b1-d09c-4682-b17d-99da8b7b1a65 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.296940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed3b1-d09c-4682-b17d-99da8b7b1a65 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.300544 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 57/116] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:03.301407 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed3b1-d09c-4682-b17d-99da8b7b1a65 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.317492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 60/117] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:03.318354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.419183 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed3b1-d09c-4682-b17d-99da8b7b1a65 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.430066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f990de-1450-42fe-92da-b1ded43bce20 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.456713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.458073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.458492 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.458784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.459699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.460805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:03.462300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8394aba-325e-4643-83e2-6e4d7b6b19f3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:03.464126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:03.466456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.466800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.467263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.467406 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.467719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.468046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.468237 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.469160 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=6d76971d245448cc8e57176c4fbeca98) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:03.475128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:03.475128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:03.477331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/role_assignments?user.id=6d76971d245448cc8e57176c4fbeca98&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:03.478234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.487207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:03.488601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:03.490935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.574615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:03.576230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.614623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d31376-8e16-4054-8bfd-dd5d8efa5bd9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.653630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.654470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.654767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.655056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.670871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:03.680983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:03.682071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:03.683066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:03.683896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.704427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abfb75-c3f4-43ca-a1cd-9b3c68ce4403 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.752569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.752816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.753823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.754116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.754470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.764620 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:03.770636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:03.780935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:03.782080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:03.783064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:03.784780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:03.785957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.821081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07474a-46ce-4108-a183-76667f64c005 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.866860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.867750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.868034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.868323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.870181 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:03.872185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:03.874845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 63/123] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:03.875966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:03.898894 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d2e28-de31-4c9f-a012-a36e30c0422c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:03.941945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:03.941945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:03.941945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:03.941945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:03.949695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:03.959028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:03.960096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:03.961149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:03.963677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 61/124] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:03.964807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.015438 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a7422-ceea-4929-b6e1-d529d4b1d0b3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.029761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.046611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.063309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.064015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.064311 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.064669 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.068575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:04.068575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.068575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.078891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49f1e0-a8a5-4e22-a706-68d1a0d0d968 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.084432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.084432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.136282 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.138001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.138519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.139046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.140028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:04.140605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.142428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.151497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.152835 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.226979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13913ea1-e92f-4fb0-813c-c185e82961d4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.264891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.266239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.266759 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.267309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/e69a95399e314f24bd40d95c9769572a/roles/9c32a0917e444135870b906aa819927d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.269783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, user_id=e69a95399e314f24bd40d95c9769572a, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.271537 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.275956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b216f31-d97d-4459-aedb-4c55656101d2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.298228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.312916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.314084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.314084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.314278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.314986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:04.315305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.316739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.326343 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 63/127] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.327013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.341462 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 65/128] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:04 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/e69a95399e314f24bd40d95c9769572a/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:04.343201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.408866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.475531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d06d4c-f921-4634-8cb7-f40a8b356dd8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.521644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.523051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.523781 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.524239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.526340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.528842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.531724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 66/129] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.532803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.533862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678356d-e3c2-477e-b63d-96b0b74b032b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.582526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.582914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.583328 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.583708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.586132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.587800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.589880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 64/130] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.590554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.704435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb7930-5f95-40f7-98e5-4dc576cdc404 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.710678 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.713445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:04.753165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca32095-2527-41c7-9905-e78f3f1236dc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.765387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.766401 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.766711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.767074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.773338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.774864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.776957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 67/131] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.777585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.798008 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:04.799293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:04.799819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:04.800326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:04.803434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:04.805182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:04.807164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 65/132] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:04.809906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:04.974087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1181-141d-4faf-8adb-b7230175ffe9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:04.986831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c542426-ff1c-445b-b718-1b75ecf10d54 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.010897 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.025582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.026830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.027341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.027927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] PATH_INFO: `/v3/projects/24e36ca547f74a2aa14d4740331161eb` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.030265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] RBAC: Authorizing `identity:get_project(project_id=24e36ca547f74a2aa14d4740331161eb)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.031972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.034021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 66/133] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/projects/24e36ca547f74a2aa14d4740331161eb => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:05.038506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.077145 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.078383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.078383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.078598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.079850 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.081338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.083079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 68/134] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:04 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:05.089672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.159552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbbc2d-19ac-4a2c-b311-3cc66884f270 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.189726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.196720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.197992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.198518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.198992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/e69a95399e314f24bd40d95c9769572a/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.202388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, user_id=e69a95399e314f24bd40d95c9769572a, role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.204071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.259832 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07989c44-2f21-4145-82ef-bef305615e8e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.306507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:05 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/e69a95399e314f24bd40d95c9769572a/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:05.307685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.315277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.317724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.319148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.321151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] PATH_INFO: `/v3/projects/24e36ca547f74a2aa14d4740331161eb/users/e69a95399e314f24bd40d95c9769572a/roles/9c32a0917e444135870b906aa819927d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.326421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] RBAC: Authorizing `identity:create_grant(project_id=24e36ca547f74a2aa14d4740331161eb, user_id=e69a95399e314f24bd40d95c9769572a, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.328444 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b510e84-9875-41f4-988e-f4c53177b733 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.377967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.444115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231af45-9fc4-4b8d-a861-ab26fe73a194 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.456851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:05 2022] PUT /identity/v3/projects/24e36ca547f74a2aa14d4740331161eb/users/e69a95399e314f24bd40d95c9769572a/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:05.458226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f25e1-c02e-4d97-80f6-9f3cbbff1fb9 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.458736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f25e1-c02e-4d97-80f6-9f3cbbff1fb9 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.459031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f25e1-c02e-4d97-80f6-9f3cbbff1fb9 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.462103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 70/137] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:05.468567 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.468926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.469226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.497509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.498858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.499364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.499881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/28f47b2146194815a01965579698893d/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.502329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, user_id=28f47b2146194815a01965579698893d, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.504207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e7282-b258-48b1-92c4-c10bd37e4de8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.504778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:05.506046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:05.610194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 71/138] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:05.611168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 68/139] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:05 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/28f47b2146194815a01965579698893d/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:05.656713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.702083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.710377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca7c2-850e-4e18-a16a-6442b3703b12 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.711078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca7c2-850e-4e18-a16a-6442b3703b12 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.712036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ca7c2-850e-4e18-a16a-6442b3703b12 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.713798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 69/140] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:05.720167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.720767 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.721063 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.755870 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:05.758367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:05.781389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e167ff-1723-4f11-910b-aab3a0618834 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.824438 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.825688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.826200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.826706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.828191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.829994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:05.832357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 72/141] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:05.838060 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.840507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:05.864839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:05.903756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.951989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2e487-d5d8-4d48-8a3a-297d6c5ebca9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.960693 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:05.976356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93e804-b22b-4f11-a7cb-7a274fedcbce None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:05.991635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:05.993364 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:05.994029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:05.994816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:05.995821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:05.997973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:06.019503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:06.020780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.021315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.021916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.034966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:06.045307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:06.046517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:06.047532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:06.049955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 71/143] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:06.056249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:06.089039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 73/144] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:05 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:23:06.229292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b115-4499-4f0e-af18-07fb4d4f537d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:06.232746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:06.270037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:06.270745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.271280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.271575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.272355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:06.272708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:06.274141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:06.284439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 72/145] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:06.290398 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:06.405084 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b66c8c-e7c4-4ab3-a8e5-ab65a1485403 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:06.441917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:06.442830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.443127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.443417 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] PATH_INFO: `/v3/users/6d76971d245448cc8e57176c4fbeca98` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.444699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] RBAC: Authorizing `identity:get_user(user_id=6d76971d245448cc8e57176c4fbeca98)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:06.446184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:06.448185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 74/146] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:06 2022] GET /identity/v3/users/6d76971d245448cc8e57176c4fbeca98 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:06.454281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:06.561395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d7967-4635-46b2-89f0-de630495d551 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:06.596663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:06.598000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.598296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.598584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.599813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:06.601319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689ea0d-df0c-4300-8cb4-420ed3a4fd50 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:06.603056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 73/147] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:06 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:06.609520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:06.646819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:06.722056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e7227-a8d0-4858-b180-42d109215664 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:06.759976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:06.760920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.761463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.761749 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/6d76971d245448cc8e57176c4fbeca98/roles/27c27f88b5e74348aaeb31c943b8508d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.763815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, user_id=6d76971d245448cc8e57176c4fbeca98, role_id=27c27f88b5e74348aaeb31c943b8508d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:06.765315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83812d71-17f7-40a7-a402-d8440217c7f8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:06.849995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 75/148] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:06 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/users/6d76971d245448cc8e57176c4fbeca98/roles/27c27f88b5e74348aaeb31c943b8508d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:23:06.972765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e51-c8f6-4b4e-a5d4-fdbd89d18730 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.973446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e51-c8f6-4b4e-a5d4-fdbd89d18730 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.973446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e51-c8f6-4b4e-a5d4-fdbd89d18730 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:06.974715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 74/149] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:06.990297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:06.990644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:06.990865 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:07.009566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:07.010792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:07.093611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 76/150] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:07.143329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31503e51-c8f6-4b4e-a5d4-fdbd89d18730 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:07.176657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:07.277442 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31503e51-c8f6-4b4e-a5d4-fdbd89d18730 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:07.328450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:07.329282 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:07.329570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:07.329851 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:07.341426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:07.353514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:07.354609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:07.355609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:07.363234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:07.405947 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:07.516044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67c72a-1332-4294-8539-c5a7923f5be8 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:07.562047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:07.562742 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:07.563029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:07.563307 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:07.564070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:07.564382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:07.565796 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:07.577442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:07.583281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:07.699201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:07.717246 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45481fa-2e9f-4b41-bec2-0b9e55effd57 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:07.759978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:07.760914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:07.761460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:07.761741 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:07.763561 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:07.765159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:07.766837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:07 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:07.772669 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:07.892264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:07.914997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4df9-1174-41c1-a532-0907da2cbc04 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:07.955446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:07.956027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:07.956326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:07.956647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:08.043422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:08.044954 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:08.155914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:08.176515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 78/154] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:08.182448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:08.337637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74117-50a9-4161-b55b-424bfb2601aa None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:08.381332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:08.382215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:08.382505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:08.382787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:08.384002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:08.385482 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58492038-a7ab-4ec2-9a6d-fa5ceb4079ac None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:08.388102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:08 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:08.394154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:08.569668 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be9eb4-b330-41b2-9a66-92cebc2d64f6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:08.612158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:08.612833 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:08.613130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:08.613469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:08.614319 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:08.614637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:08.616111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0413df7-f151-4227-82e7-5323a7dd8b91 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:08.622992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:08 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=9c32a0917e444135870b906aa819927d => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:08.818592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfabc-a944-47ad-8d82-a22c33dcbd4f None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:08.818879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfabc-a944-47ad-8d82-a22c33dcbd4f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:08.819397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfabc-a944-47ad-8d82-a22c33dcbd4f None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:08.821302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 78/157] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:08.826997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:08.827597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:08.828131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:08.850233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:08.851880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:08.903833 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:08.937111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 80/158] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:08.994078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfabc-a944-47ad-8d82-a22c33dcbd4f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.022405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:09.115625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfabc-a944-47ad-8d82-a22c33dcbd4f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:09.158447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:09.159201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.159488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.159772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.177068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-de3cad1f-f73d-4e5a-97c5-d8fdb4231347 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:09.185173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:09.186733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:09.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 79/159] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:09.192357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.258527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad90b-2b3d-4994-ac64-d1b24ad411b6 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.258964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad90b-2b3d-4994-ac64-d1b24ad411b6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.259151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ad90b-2b3d-4994-ac64-d1b24ad411b6 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.260698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 80/160] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:09.266448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.266721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.267005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.302953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:09.304162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:09.373086 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed3d4b-49e0-4384-94be-505b55330972 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:09.444277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 81/161] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:09.447136 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:09.447834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.448133 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.448428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.449283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:09.449598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:09.451029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:09.464544 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 81/162] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:09.470308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.485541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.495580 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:09.545117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:09.627369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee241f22-9231-4dc9-bbd6-9647455680a5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:09.665291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbd129-96ab-4b45-8048-d21c524677e5 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:09.693756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:09.694710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.694938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.695219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.699567 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:09.701610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf0857-072b-47bc-88f0-3cdd81475988 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:09.703996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:09.705226 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74838-7261-4631-8cf2-62111ef28c0e None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.705517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74838-7261-4631-8cf2-62111ef28c0e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.705799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74838-7261-4631-8cf2-62111ef28c0e None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.707187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 83/164] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:09.713627 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.713920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.714205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.733811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:09.734644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.734930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.735210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.746108 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:09.747338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:09.758196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:09.771887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:09.773013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:09.774014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:09.776969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 82/165] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:09.778735 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.822124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 84/166] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:09.823347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.841437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:09.928834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0035f91-5860-4751-9862-7b78aae9fb4f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:09.965374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:09.966475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:09.966982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:09.967545 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:09.968576 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:09.969129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:09.970738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:09.979525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 85/167] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:09.980693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:09.994427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.002514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b382118-1d16-4f74-8ba3-9658c04097a1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.068780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.088369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933356a-124f-4b9f-8568-6d987711b173 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.123989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.124820 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.125148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.125436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.127899 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.128979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.129503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.130016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.142152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:10.157152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:10.158303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:10.159307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:10.162037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:10.163091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:10.248248 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:10.249680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:10.304089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb0c6-43f6-4a4f-84c6-9d62804b26b5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.336859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.342000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.343222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.343897 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.344392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] PATH_INFO: `/v3/users/e69a95399e314f24bd40d95c9769572a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.345953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] RBAC: Authorizing `identity:get_user(user_id=e69a95399e314f24bd40d95c9769572a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:10.347773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:10.349757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 87/169] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/users/e69a95399e314f24bd40d95c9769572a => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:10.350758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:10.427497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.437386 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 83/170] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:10.438233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:10.461000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006298d-ee3d-4398-a16e-3b41a3b42f2c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.499126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.500161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.500741 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.501268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.502357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:10.502885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:10.504711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:10.514164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 88/171] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:10.515258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:10.598836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2c25-392c-4cb4-9ecc-c3162e26fd1c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.651244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.691668 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.692350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.692663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.693067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.734664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefe7a-f6a8-4e6b-a7c2-7a9006bb50ab None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:10.807648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:10.808479 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:10.808772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:10.809099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] PATH_INFO: `/v3/projects/24e36ca547f74a2aa14d4740331161eb` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:10.813624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] RBAC: Authorizing `identity:get_project(project_id=24e36ca547f74a2aa14d4740331161eb)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:10.815127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:10.816910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 89/172] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/projects/24e36ca547f74a2aa14d4740331161eb => generated 312 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:10.817789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:10.832015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:10.840953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:10.851731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:10.959480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 84/173] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:10.960452 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.046019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950945a-98a7-49a8-8908-be54865d16d5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.077930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.083504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.085716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.086849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.091025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.091025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] PATH_INFO: `/v3/users/28f47b2146194815a01965579698893d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.091260 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981f1a0-0be9-4c7a-8d68-48860af3efed None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.091366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] RBAC: Authorizing `identity:get_user(user_id=28f47b2146194815a01965579698893d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.091651 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f89a8-3840-4241-8597-055debfb3da3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.093751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 90/174] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/users/28f47b2146194815a01965579698893d => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:11.095184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188cbd-5a9e-4e60-9fdc-1727693a2723 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.095625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188cbd-5a9e-4e60-9fdc-1727693a2723 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.096059 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc188cbd-5a9e-4e60-9fdc-1727693a2723 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.097492 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 91/175] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:11.098322 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188cbd-5a9e-4e60-9fdc-1727693a2723 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.131818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.132694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.133106 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.133487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.134450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=24e36ca547f74a2aa14d4740331161eb, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:11.134853 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.136702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfd21bf-0b52-4e09-a720-5def379c3389 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.144464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 85/176] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:10 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=24e36ca547f74a2aa14d4740331161eb&role.id=9c32a0917e444135870b906aa819927d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:11.152437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5cb6-5186-410e-8878-1a06bfb20de4 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.152437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5cb6-5186-410e-8878-1a06bfb20de4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.152437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5cb6-5186-410e-8878-1a06bfb20de4 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.152437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 86/177] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:11.154324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5cb6-5186-410e-8878-1a06bfb20de4 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.233632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc188cbd-5a9e-4e60-9fdc-1727693a2723 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.271075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5cb6-5186-410e-8878-1a06bfb20de4 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.273187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.274330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.274918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.275639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.277261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.279778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ed411-0cb3-4491-91fa-19cfdd433d7f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.281966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 92/178] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:11.288664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee226-51e8-42e1-8099-d563c19838c0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.289285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee226-51e8-42e1-8099-d563c19838c0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.289799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee226-51e8-42e1-8099-d563c19838c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.308184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-caeee226-51e8-42e1-8099-d563c19838c0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:11.310459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-caeee226-51e8-42e1-8099-d563c19838c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:11.311451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.312129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.312446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.312736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.348520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.378317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.388712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 93/179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:11.389849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1cbd-28aa-4f65-873c-993d113c84ef None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.390144 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1cbd-28aa-4f65-873c-993d113c84ef None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.390455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1cbd-28aa-4f65-873c-993d113c84ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.402601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.404118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879328e2-7b2b-4ff0-a56e-11784f894100 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.408644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-055e1cbd-28aa-4f65-873c-993d113c84ef None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:11.409831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-055e1cbd-28aa-4f65-873c-993d113c84ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:11.476508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 94/180] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:11.477851 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099df1-1631-4896-826e-28b482ccff3f None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.478152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099df1-1631-4896-826e-28b482ccff3f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea099df1-1631-4896-826e-28b482ccff3f None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.480461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 95/181] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:11.480461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099df1-1631-4896-826e-28b482ccff3f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 87/182] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147019b8-3f11-4c5e-b09e-857c875999c5 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147019b8-3f11-4c5e-b09e-857c875999c5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147019b8-3f11-4c5e-b09e-857c875999c5 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 88/183] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:11.513700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147019b8-3f11-4c5e-b09e-857c875999c5 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.574205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.594279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea099df1-1631-4896-826e-28b482ccff3f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.613506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147019b8-3f11-4c5e-b09e-857c875999c5 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.619265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.628371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.629052 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.629339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.629625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.630458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=e69a95399e314f24bd40d95c9769572a) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:11.630770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.632220 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17ac02-e510-4764-9212-cc8e4ce78d18 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.638992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 96/184] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/role_assignments?user.id=e69a95399e314f24bd40d95c9769572a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:11.640186 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.640569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.640857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.657410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.658737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.658895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:11.659390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.659861 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.660009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:11.673225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:11.682066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:11.683225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:11.684959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:11.691333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 89/185] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:11.691333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.737818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 97/186] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:11.739257 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.807901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823283c3-c1b4-4f56-94fe-34031d6bcbff None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.834529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.849191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.849579 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.851690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.851690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.862823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-03c2ed3a-8734-49fa-bcd2-5ff5b6d0c68d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:11.870432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:11.872290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:11.873521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 90/187] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:11.878798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.879353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.879473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924c30e-de60-424a-b974-d1aaf10bc18e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:11.880026 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.899601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:11.901056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:11.902265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:11.912964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:11.913840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:11.914122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:11.914400 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:11.915617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:11.917133 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:11.919354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 98/188] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:11.920110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:11.970517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:11.971368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.048432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90703439-09c1-48e1-832c-0e1fd561605b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.081801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.082475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.082766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.083049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.083802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:12.084115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.085539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.094339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.099132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.119963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4200-1d41-4f06-a3a3-8bf877dc9bd8 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.133844 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.145333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.155674 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.156550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.156836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.157112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.167366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:12.176910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:12.180341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 92/191] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:12.181378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.198644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea47b1f-9df2-4446-abf8-9aaf42f81016 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.233517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.234190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.234479 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.234766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.235513 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:12.235825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.237246 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.245516 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.246490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.279961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b808-4343-45f9-a7fc-e25de6f2a4e2 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.313082 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.313752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.314041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.314324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.315161 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=28f47b2146194815a01965579698893d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:12.315477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.316991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.322973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 93/193] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/role_assignments?user.id=28f47b2146194815a01965579698893d&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.323596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.359769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb804-6b15-4471-8881-26b799fbb9e6 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.367351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.375545 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.397945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.398758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.399083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.399365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.401193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.402684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.405132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 101/194] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.405804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.441248 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fed68-5c9d-4cf2-a7b5-8672579cedd1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.479454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.480365 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.480696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.481531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.498074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.499581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.501384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 94/195] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.506065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.524238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e7f5a-c45e-4ab1-80b3-0e1752e4e825 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.563462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.564146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.564452 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.564733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.565494 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:12.565806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.567198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.576558 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 102/196] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.576963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.610698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.617140 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef45fb-124c-44d4-bac5-b954b19025bb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.622571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.653419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.653643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.653932 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.654214 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] PATH_INFO: `/v3/users/6d76971d245448cc8e57176c4fbeca98` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.655440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] RBAC: Authorizing `identity:get_user(user_id=6d76971d245448cc8e57176c4fbeca98)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.656927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.658570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 95/197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/users/6d76971d245448cc8e57176c4fbeca98 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.659428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.678776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ead4-462b-4ac2-9f84-67fbbb4ec521 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.711673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.712382 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.712704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.712983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.713692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.715155 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.757256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf482e0-32f4-4aab-80aa-e76afb4af36d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.792172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.792854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.793147 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.793455 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.808226 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 103/198] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:12 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:12.808226 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:12.835373 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.880311 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.881853 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.934563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:12.935291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd6f2c-1a50-4ccc-8c70-5afde30f2983 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:12.975900 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:12.976844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:12.977504 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:12.977790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:12.979347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:12.980949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:12.982777 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 104/199] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:12.983392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.000137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 96/200] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:13.001186 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.088952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.113227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e93d3-feb0-4c67-a0ca-84ea1a9ce942 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.140375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b27fe-bd2a-4360-8375-6f8027634006 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.151586 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.152254 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.152592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.152916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.188301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.189035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.189331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.189618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.192968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.239715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.242013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.277058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.278597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.356941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.377034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 105/201] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:13.379027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.412818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 97/202] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:13.413765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.466320 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.515568 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53251f00-18f2-452e-91f2-ed33fe1183cd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.530304 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f180ff-4c9a-4ba0-8713-6e7ee748b45d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.552387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.553737 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.554033 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.554317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.555541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.557509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.560986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 106/203] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:13.562233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.572835 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.574265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.574658 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.575455 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.577169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.579262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.582235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 98/204] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:13.583786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.624136 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.683051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f1abd-9fb8-4c18-bb2a-927b4e6ed617 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.719132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.719935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.720225 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.720543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.721770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0f2e-69d5-43c1-9414-e39ece0e4388 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.721951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.723341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.725590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 107/205] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:13.726806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.729929 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.768067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.769064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.769524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.770378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.771443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=0a5f8a9780db487791e73c2ef57b27c0) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:13.772289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.775284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.783953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 99/206] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/role_assignments?user.id=0a5f8a9780db487791e73c2ef57b27c0&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:13.785106 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:13.846231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52becb3f-fbd2-45f2-94eb-559d0c3fc895 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.884822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.885586 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.885881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.888110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, scope.project.id=b96dfee913fc4da88a3350a05c943c99, user.id=6d76971d245448cc8e57176c4fbeca98) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:13.888565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.891159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d8cef-4567-4fea-9fab-8e8737b0b73e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.900028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 108/207] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/role_assignments?user.id=6d76971d245448cc8e57176c4fbeca98&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:13.919237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:13.928349 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61670-67dd-42b3-9598-ef72acd42715 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:13.975120 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:13.976142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:13.976620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:13.977090 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:13.978121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=0a5f8a9780db487791e73c2ef57b27c0) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:13.978624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:13.980358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633463ea-2e37-4fd7-81f8-4c99f30fdf22 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:13.991170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 100/208] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:13 2022] GET /identity/v3/role_assignments?user.id=0a5f8a9780db487791e73c2ef57b27c0&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:15.149685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98038f-dde4-4638-9ee1-1d42446aa51b None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.150263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98038f-dde4-4638-9ee1-1d42446aa51b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.150263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98038f-dde4-4638-9ee1-1d42446aa51b None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.151817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 109/209] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:15.157409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.158240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.158753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.169910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df5fc-a5b2-4680-a9c7-38431eefe502 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.170222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df5fc-a5b2-4680-a9c7-38431eefe502 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.170484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58df5fc-a5b2-4680-a9c7-38431eefe502 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.172175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 110/210] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:15.177031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.177326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.177646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.178777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:15.180200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:15.195488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:15.196751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:15.262346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:15.272726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 101/212] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:15.284536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 111/212] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:15.296014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.297509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.386545 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:15.400134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a666a3-b492-4c9c-91ec-6debff552d97 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:15.427141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60dee-ec1c-4e48-af37-86b666e0f3ae None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:15.437850 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:15.439053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.439589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.440152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.441623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:15.443486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:15.450109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 102/213] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:15.451172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.466932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:15.467923 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.468205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.468536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.484014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:15.492745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:15.493818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:15.494840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:15.497764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 112/214] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:15.508435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.576195 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596afdd5-dcda-4451-a0b3-828dfb806c8a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:15.609757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98b449-0b8b-4b9b-b845-39e1446be3e3 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:15.612687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:15.621316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:15.622358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.627480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.627480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.627480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:15.627480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:15.646643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:15.647395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.647978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.648427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.649521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:15.650429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:15.651941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:15.661589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 113/215] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:15.666826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.697395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 103/216] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:15 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:15.789958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd842df1-3e66-4a37-b974-08b986f9f5e0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:15.810328 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:15.829905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:15.830838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:15.831127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:15.831420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] PATH_INFO: `/v3/users/a7ff0614e794402397a29a0634525e88` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:15.849103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ff0614e794402397a29a0634525e88)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:15.850649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6fe3-9a1e-4a58-921a-909ed52a6ca2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:15.856781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 114/217] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:15 2022] GET /identity/v3/users/a7ff0614e794402397a29a0634525e88 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:15.861538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:15.878808 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:15.976152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e8a2-edf9-4fd6-849c-dbe97134341f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.016600 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.017694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.017990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.018274 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.049067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3c9c-12aa-4c11-8293-85eda1412e3b None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.049410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3c9c-12aa-4c11-8293-85eda1412e3b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.049721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e3c9c-12aa-4c11-8293-85eda1412e3b None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.051297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 115/218] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:16.057358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdc929-4934-43c0-afd2-2010c05f3c48 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.057649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdc929-4934-43c0-afd2-2010c05f3c48 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.057942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdc929-4934-43c0-afd2-2010c05f3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.084997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-3ecdc929-4934-43c0-afd2-2010c05f3c48 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:16.086329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3ecdc929-4934-43c0-afd2-2010c05f3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:16.111015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:16.113100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:16.132546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.177134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 116/219] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:16.179928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb30cd-cd48-4b02-a74f-b6977e1a6b5c None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.179928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb30cd-cd48-4b02-a74f-b6977e1a6b5c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.180163 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb30cd-cd48-4b02-a74f-b6977e1a6b5c None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.184441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 117/220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:16.190014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.190335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.190629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.210873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:16.212193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:16.267304 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 104/221] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:16.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.301783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 118/222] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:16.303200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.360795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.406778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fe338-da38-45e6-9672-313fd4608a24 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.425171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.428788 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dcc04-eb11-4a84-b14e-fcfccaf501d4 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.448679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.449624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.449919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.450202 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.462152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:16.468697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.469942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:16.470346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:16.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:16.472480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:16.474022 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.474551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.476136 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:16.476777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 105/223] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:16.477678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.478650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:16.486174 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 119/224] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:16.487333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.586915 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab4011-6065-4066-b4c5-917ee823d1f3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.594218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35850350-cc01-4ab0-a124-894042c7ffd2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.597073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.624689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.625917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.626384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.626863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.632562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.633300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.633668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.634119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.635098 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:16.635550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:16.637472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:16.642521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:16.655498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 120/225] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:16.655498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:16.657560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:16.658743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:16.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:16.662456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 106/226] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:16.663607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.699361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.759156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad9971-08af-452d-b61f-78372d6c3c1c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.779170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e3572-dc5b-4425-babd-aff03cb08471 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:16.795438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.796160 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.796397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.796728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.797659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=a7ff0614e794402397a29a0634525e88) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:16.797893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:16.799382 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:16.812863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 121/227] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/role_assignments?user.id=a7ff0614e794402397a29a0634525e88&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=9c32a0917e444135870b906aa819927d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:16.813876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.820064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:16.821264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:16.821797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:16.822292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:16.823767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:16.825923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:16.828310 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 107/228] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:16.834494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:16.906427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.950378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:16.954488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa9e7e-65ce-427d-b89b-9ae4b8038e06 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.000184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.001097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.001997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.001997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.002996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.004509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.006539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 108/229] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:17.013480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:17.050508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1e21-0d88-42be-bf44-99a20c496df1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.134955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff646909-50bc-4012-90c4-90785c77c12c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.149796 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.150505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.150906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.151102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.151827 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:17.152139 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.154189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.172656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 122/230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:17.173551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:17.178072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.179369 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.179900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.180440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/0a5f8a9780db487791e73c2ef57b27c0/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.182836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, user_id=0a5f8a9780db487791e73c2ef57b27c0, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.184610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.277688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 109/231] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:17 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/0a5f8a9780db487791e73c2ef57b27c0/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:17.303143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:17.312082 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeaf5c-184e-4836-9765-3b14c5fd9039 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.362995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.363898 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.364187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.364499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.365737 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.367213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.369218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 123/232] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:17 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:17.375118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:17.430027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:17.523959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee732de9-9f2d-49c3-a8dc-7956c0eee294 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.561576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.562867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.563376 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.563888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.565413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.567146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c15a-c71b-4324-afeb-65ec9c81dd09 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.569543 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 110/233] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:17 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:17.575688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:17.680634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a7829-5dde-4579-9e9d-9bb2bb9c9980 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:17.719898 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:17.720844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:17.721129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:17.721412 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/0a5f8a9780db487791e73c2ef57b27c0/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:17.723665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, user_id=0a5f8a9780db487791e73c2ef57b27c0, role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:17.725171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1e6f5-8760-45bb-959e-a8206c007457 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:17.820938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 124/234] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:17 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/0a5f8a9780db487791e73c2ef57b27c0/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:18.213866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429e7d-948b-4582-9106-3b5a89a47b3e None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.214287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429e7d-948b-4582-9106-3b5a89a47b3e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.214487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429e7d-948b-4582-9106-3b5a89a47b3e None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.216805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 111/235] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:18.222827 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde3ee-93f0-4fee-b0d2-92deb8720978 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.223170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde3ee-93f0-4fee-b0d2-92deb8720978 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.223404 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cde3ee-93f0-4fee-b0d2-92deb8720978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.241634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-69cde3ee-93f0-4fee-b0d2-92deb8720978 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:18.242847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-69cde3ee-93f0-4fee-b0d2-92deb8720978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:18.257707 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:18.338095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 125/236] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:18.350555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2d5f-d70d-4d4f-aa3d-8c6b3d7ec32c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.351029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2d5f-d70d-4d4f-aa3d-8c6b3d7ec32c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.351138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa2d5f-d70d-4d4f-aa3d-8c6b3d7ec32c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.352475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 112/237] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:18.358367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.359090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.359988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.376927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:18.378183 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:18.382398 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa2d5f-d70d-4d4f-aa3d-8c6b3d7ec32c None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:18.502271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 126/238] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:18.541198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:18.553506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:18.564419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa2d5f-d70d-4d4f-aa3d-8c6b3d7ec32c None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:18.601093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:18.602165 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.602623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.603075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.604505 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:18.606194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:18.608415 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 113/239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:18.616165 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:18.701120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:18.731541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983a040-aa0c-44f6-a84a-ebd226268e18 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:18.738566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aab9b-53d4-46e5-a23e-0b062b2d3fb0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:18.772874 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:18.773569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.773861 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.774146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.774871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:18.776360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:18.805829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:18.806688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:18.807047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:18.807329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:18.819639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:18.828371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:18.829460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:18.830686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 127/240] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:18.835675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:18.911474 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 114/241] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:18 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:18.963828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89653d-8af8-41de-ac69-4ffee982a744 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.013447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.014161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.014454 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.014730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.015505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:19.015817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:19.017286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:19.026906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 128/242] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:19.032649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.073829 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.169395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f480bd4-570f-4e5a-9f0b-91c9d1a9003c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.206304 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.207201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.207490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.207770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] PATH_INFO: `/v3/users/e93b54d8487b46389870817daa8369d4` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.221564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] RBAC: Authorizing `identity:get_user(user_id=e93b54d8487b46389870817daa8369d4)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:19.223098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769811b-81b8-40fe-a78b-521566fe63e7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:19.231974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 115/243] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/users/e93b54d8487b46389870817daa8369d4 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:19.233425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.264911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.329796 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab026f-6276-474f-94c9-abfd2d0c8b3c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.330086 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab026f-6276-474f-94c9-abfd2d0c8b3c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.330372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab026f-6276-474f-94c9-abfd2d0c8b3c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.331776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 116/244] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:19.341777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.342078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.342352 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.355626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a6984-64f1-4eba-ad5f-e2d666da5d81 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.362511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:19.363781 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:19.407401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.408074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.408360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.409522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.450406 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 117/245] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:19.476423 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.490526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.502233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:19.503738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:19.506305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.613705 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e18057-919c-46a5-bc4e-891bcb039713 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.643889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 129/246] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:19.649512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.657514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.658547 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.658994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.659454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.673528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:19.681822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:19.682961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:19.684105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 118/247] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:19.689322 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.764738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.790462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4ceb1-344e-4a9f-afee-9ab2eeecb2b6 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.793188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:19.802009 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b139c9-d45e-44c1-b42b-e4b20fbdddf2 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:19.843618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.844536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.844822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.845100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.846452 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:19.847934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:19.854599 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 130/248] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:19.856522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:19.869162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:19.869880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:19.870179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:19.870472 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:19.871249 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:19.871615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:19.873082 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:19.898780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 119/249] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:19.904454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:20.088260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df0079-3ae0-45cb-8d31-4724a288c2d8 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.149540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053a78f-ee59-4113-b59d-6699a870f379 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.154605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.155268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.155559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.155845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.156721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=e93b54d8487b46389870817daa8369d4) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:20.157043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:20.158539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41d594-b91f-4a78-ad2d-e125f8090eb0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:20.172587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 131/250] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/role_assignments?user.id=e93b54d8487b46389870817daa8369d4&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:20.173941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35e47e-2592-4866-981f-75148d54eb92 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.174243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35e47e-2592-4866-981f-75148d54eb92 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.174529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35e47e-2592-4866-981f-75148d54eb92 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.175990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 132/251] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:20.183557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.183941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.184188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.214634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:20.221486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:20.231128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:20.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.231280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] PATH_INFO: `/v3/users/a7ff0614e794402397a29a0634525e88` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.231954 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] RBAC: Authorizing `identity:get_user(user_id=a7ff0614e794402397a29a0634525e88)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:20.233496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:20.240393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 120/252] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:19 2022] GET /identity/v3/users/a7ff0614e794402397a29a0634525e88 => generated 297 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:20.241360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:20.288020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:20.361488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 133/253] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:20.401559 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d038b-4562-49dd-8c7a-4cd85f485f2a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.420462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:20.465788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.466695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.466993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.467283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.468654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:20.470132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:20.472036 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 121/254] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:20 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:20.477743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:20.570924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1001ebe-4de9-4415-a1de-d2f6772866db None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.624004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:20.625230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.626048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.626330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.626611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.646944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-29102149-f1e1-4cf4-a560-a581cdd1e5c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:20.660252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:20.661433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:20.662423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 134/255] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:20.663730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543e73-1850-4c06-a41d-a104d62cea38 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.663973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543e73-1850-4c06-a41d-a104d62cea38 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.664133 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f543e73-1850-4c06-a41d-a104d62cea38 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.666923 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 135/256] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:20.677726 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543e73-1850-4c06-a41d-a104d62cea38 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:20.700239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56285e5-e576-4a81-b16c-387b77b20389 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.727849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:20.758523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.759596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.759936 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.760224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/a7ff0614e794402397a29a0634525e88/roles/9c32a0917e444135870b906aa819927d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.763198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, user_id=a7ff0614e794402397a29a0634525e88, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:20.764827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728e650-2f1b-4c24-9afd-2255b5a31f35 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:20.826155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 122/257] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:20 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/a7ff0614e794402397a29a0634525e88/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:20.827546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.827846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.828131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.859213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f543e73-1850-4c06-a41d-a104d62cea38 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:20.865858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:20.872159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:20.950781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:20.951397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:20.951693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:20.951977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:20.952781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:20.953097 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:20.954527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:20.966789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 123/258] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:20.975628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 136/259] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:20.982303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.008574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.123254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:21.206199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5d17-9cd1-4edd-9773-3d7996c5c0d1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:21.215824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:21.250503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88994a2-efaf-4f49-975f-a97cd5842729 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:21.292476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:21.293921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:21.294210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:21.294492 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:21.294688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:21.295530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:21.295825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:21.296111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:21.297517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:21.299174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:21.304766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 124/260] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:20 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:21.309651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.319086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:21.327839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:21.330252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:21.332455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 137/261] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:21.337847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.487569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cd19c-0a3a-4dd5-916c-8fd1f6e57447 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:21.522831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:21.543115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e02b4-04f5-4fff-9857-edf365443a0c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:21.551116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:21.551116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:21.551116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:21.551116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:21.610347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:21.611042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:21.611333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:21.611616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:21.612598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:21.612917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:21.614729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:21.632152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 138/262] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:21.637694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.660536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:21.729510 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:21.732908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:21.807296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a6ccc-9e46-4925-9464-e2b74a1258d2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:21.890796 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:21.891713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:21.892007 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:21.892264 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] PATH_INFO: `/v3/users/0a5f8a9780db487791e73c2ef57b27c0` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:21.897257 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] RBAC: Authorizing `identity:get_user(user_id=0a5f8a9780db487791e73c2ef57b27c0)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:21.904430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:21.904430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 139/263] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/users/0a5f8a9780db487791e73c2ef57b27c0 => generated 283 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:21.913402 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.945372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 125/264] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:21.953374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:21.988663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.084065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca45a2-7351-4fc1-98ed-808bd521858b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.086765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.123108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.123994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.124281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.124593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.125831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:22.127313 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:22.129508 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 126/265] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:22.135929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:22.147349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ae493-f022-42a2-a0df-054bc1b93e62 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.193778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.194868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.195425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.195919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.236790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.243739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03805c97-ceec-4fda-a680-871f0bbf95ac None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.280848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.281963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.282126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.282522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.283737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=0a5f8a9780db487791e73c2ef57b27c0) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:22.284117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:22.286032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12d00eb-827e-41e6-b576-b91c80c59c93 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:22.301564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 127/266] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:22 2022] GET /identity/v3/role_assignments?user.id=0a5f8a9780db487791e73c2ef57b27c0&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:22.302861 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811e4e-117a-40cb-8aeb-d25aa6a65309 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.303155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811e4e-117a-40cb-8aeb-d25aa6a65309 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.303440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2811e4e-117a-40cb-8aeb-d25aa6a65309 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.309585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 128/267] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:22.317425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:22.319263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:22.324761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.325058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.325344 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.356994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:22.356994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:22.459304 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.510489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 129/268] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:22.511110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 140/269] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:22.516706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:22.554405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:22.680859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.701073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445690-cc67-4355-9545-6bfe5fa98dad None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.722968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eab17-e47e-4ec1-b825-0d0083873c17 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.744989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.746251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.746799 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.747293 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.748858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:22.750557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e21eff-0c3d-453a-a69f-b876f6529209 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:22.756511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 130/270] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:22 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:22.758153 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31087288-9cb6-468a-8312-34453b466667 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.758674 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31087288-9cb6-468a-8312-34453b466667 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.759193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31087288-9cb6-468a-8312-34453b466667 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.760754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 131/271] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:22.765229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.766048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.766568 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.766704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.768130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.768704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.769218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.779483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:22.787401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:22.788632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 141/272] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:22.790062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:22.792657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:22.794902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:22.833167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:22.880449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 132/273] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:22.880449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:22.937121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767a3f-1a45-4193-89a7-7b0524e949ef None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:22.985243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:22.986315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:22.986820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:22.987327 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:22.988489 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=0a5f8a9780db487791e73c2ef57b27c0) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:22.989540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:22.991855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:22.998786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.001885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 142/274] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:22 2022] GET /identity/v3/role_assignments?user.id=0a5f8a9780db487791e73c2ef57b27c0&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.004460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.026040 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b632a-dd54-4b9c-99ea-0e76b69f628a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.067283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.067988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.068420 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.068716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.069658 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:23.069979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.071429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2157e-f66e-42b9-97b8-ecaac60e4d0f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.082234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 133/275] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.083608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a8c7-71fb-4e20-864a-83fea817564c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.083909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a8c7-71fb-4e20-864a-83fea817564c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.084199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788a8c7-71fb-4e20-864a-83fea817564c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.089882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 134/276] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:23.092434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a8c7-71fb-4e20-864a-83fea817564c None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.148677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.155408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570623e7-7653-4d3a-a788-33794aa2eabf None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.195299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.196035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.196323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.196703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.197924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.199990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a58c6-471f-4250-a036-2a2707643e5d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.207194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 143/277] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.208521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.208830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.209125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.227415 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788a8c7-71fb-4e20-864a-83fea817564c None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.229809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:23.231062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:23.276132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.277150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.277531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.278507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] PATH_INFO: `/v3/users/a0fb28f064314364819eac2877b2ea94` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.298303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fb28f064314364819eac2877b2ea94)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.299797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.302807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 135/278] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/users/a0fb28f064314364819eac2877b2ea94 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.303404 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.308023 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.332067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 144/279] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:23.332965 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.418936 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f419a6-a301-4736-8479-4612a6d280a1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.451859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.456157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e13f3-8ab8-4ff1-8eea-ab73e5f45292 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.458946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.459356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.467022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.467022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.467022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.467022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.491713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.492380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.492697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.493053 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.493884 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, user.id=a0fb28f064314364819eac2877b2ea94, scope.system=all) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:23.494198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.495696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.501289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 145/280] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/role_assignments?user.id=a0fb28f064314364819eac2877b2ea94&scope.system=all&role.id=9c32a0917e444135870b906aa819927d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.502093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.556457 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 136/281] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:23 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:23.633747 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293ae48-8131-44db-b08e-c09087a8516f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.674436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.675272 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.675559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.675840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.688368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-ac3ece76-1ab2-4181-96e0-6a4f11f35fd4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:23.696593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:23.697778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:23.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 146/282] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:23.705097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.770268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f62c8-1493-4777-b9fb-9c3cf1bbca92 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.770611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f62c8-1493-4777-b9fb-9c3cf1bbca92 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.770845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f62c8-1493-4777-b9fb-9c3cf1bbca92 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.772506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 147/283] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:23.776323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.777554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.777883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.778168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.801009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:23.802244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:23.824174 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:23.825997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a260a-f20d-4df2-81ca-eb2756b8afa2 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:23.868280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:23.869006 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:23.869295 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:23.869584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:23.870354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:23.870673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:23.872700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:23.881301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 137/284] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:23.887432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:23.892552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 148/285] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:23.918119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.003235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934144-5a4e-4814-88c0-3ce93959d522 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.027142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:24.039189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c91ff-32ec-4033-a2fc-caa194ffd3c4 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.039392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.040209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.040636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.040926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] PATH_INFO: `/v3/users/e93b54d8487b46389870817daa8369d4` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.042374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] RBAC: Authorizing `identity:get_user(user_id=e93b54d8487b46389870817daa8369d4)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.044623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:24.046631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 138/286] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/users/e93b54d8487b46389870817daa8369d4 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:24.052275 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.086599 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.087946 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.088432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.089755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.105417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:24.117885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:24.119249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:24.120566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:24.124605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 149/287] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:24.126315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.146472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:24.190022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfcc4d0-4b1a-43d3-ab2d-55dc8b32d349 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.257901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.258701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.258987 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.259269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.260660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.262448 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:24.266881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 139/288] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:24 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:24.270540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.294279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a352f-d54d-45bb-82dd-142d74ffe9fe None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.358694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.359391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.359680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.359962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.361036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:24.361352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.363195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:24.377563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:24.379249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:24.384790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.482597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd2818-f5d8-4f81-a338-7a30ad06038f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.514464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:24.548984 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.550283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.550579 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.553201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/e93b54d8487b46389870817daa8369d4/roles/27c27f88b5e74348aaeb31c943b8508d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.557400 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, user_id=e93b54d8487b46389870817daa8369d4, role_id=27c27f88b5e74348aaeb31c943b8508d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.558912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:24.564809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e864-9bfb-4e55-bcaf-311e6e481457 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.602397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.603877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.603877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.603877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] PATH_INFO: `/v3/users/a7ff0614e794402397a29a0634525e88` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.605166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=a7ff0614e794402397a29a0634525e88)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.606719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:24.608695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:24 2022] GET /identity/v3/users/a7ff0614e794402397a29a0634525e88 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:24.614021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:24.670295 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 140/291] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:23:24 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/users/e93b54d8487b46389870817daa8369d4/roles/27c27f88b5e74348aaeb31c943b8508d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:24.753684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1eb5a-e921-43d3-847c-8cbfb4d63cc2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:24.802438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:24.803068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:24.803360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:24.803640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:24.819307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:24.900523 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:24.902023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:25.014827 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:25.020439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:25.134032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06820aa9-9d90-4ab2-a535-ee9c59d2e83e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:25.152982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:25.170059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:25.170941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:25.171720 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:25.171720 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:25.172834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:25.174301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed497-63e2-402e-a8d7-e8aa3a5386a4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:25.176357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:25 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:25.182176 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:25.255811 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:25.342231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620460a-8b60-4ddd-87be-e44c064d67a4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:25.395978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:25.396927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:25.397375 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:25.397838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:25.398848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=a7ff0614e794402397a29a0634525e88) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:25.399340 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:25.401006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5ee42-0113-49cf-bd15-19489f89cb34 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:25.416301 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:25 2022] GET /identity/v3/role_assignments?user.id=a7ff0614e794402397a29a0634525e88&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=9c32a0917e444135870b906aa819927d => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:25.725573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e0e4-3c7f-4a20-8211-a48fafcb833c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:25.726113 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e0e4-3c7f-4a20-8211-a48fafcb833c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:25.726342 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4e0e4-3c7f-4a20-8211-a48fafcb833c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:25.728092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:25.734052 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:25.734350 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:25.734636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:25.752434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:25.753626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:25.833794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 154/296] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:25.860531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4e0e4-3c7f-4a20-8211-a48fafcb833c None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:25.983629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4e0e4-3c7f-4a20-8211-a48fafcb833c None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.029579 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.030396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.030688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.030967 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.046882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:26.054875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:26.056075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:26.057114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:26.057858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 143/297] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:26.064710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.114331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.185531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb46738-c2b0-4155-adc4-5439205f4a08 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.221806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.222926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.223474 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.223968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.224962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:26.225490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:26.227105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046a5bb-1613-490e-b290-52455e7ad5ae None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:26.236350 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 155/298] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:26.242165 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.292784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.319395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785618-d7f8-4b23-996b-508bc02996fa None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.320043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785618-d7f8-4b23-996b-508bc02996fa None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.320608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9785618-d7f8-4b23-996b-508bc02996fa None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.323731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 156/299] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:26.328680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.329996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.330804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.348992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:26.350524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:26.350793 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81490e3e-bc9a-4163-8788-f31e93ca1bf4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.389797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.390896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.391194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.391480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] PATH_INFO: `/v3/users/a0fb28f064314364819eac2877b2ea94` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.392834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] RBAC: Authorizing `identity:get_user(user_id=a0fb28f064314364819eac2877b2ea94)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:26.394297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:26.396135 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 144/300] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/users/a0fb28f064314364819eac2877b2ea94 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:26.401502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.437676 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 157/301] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:26.466753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.505916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.525402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511cff-f108-432f-9852-4dcb8c6f1bbb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.541530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.561404 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.562335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.562619 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.562901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] PATH_INFO: `/v3/system/users/a0fb28f064314364819eac2877b2ea94/roles/9c32a0917e444135870b906aa819927d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.564390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0fb28f064314364819eac2877b2ea94, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:26.565823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17432e5c-8dd8-417b-b3e1-c5e1be225561 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:26.583722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de948ad-9202-4b40-ae7f-dbcf9997de60 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.617973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.618775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.619063 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.619439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.629579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-fc6c892f-5f44-41d8-b7f9-033beb9ee7d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:26.637696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:26.644012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 158/302] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:26.645056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2520f-c72d-438b-bb3b-bf245a0fbe32 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.645941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2520f-c72d-438b-bb3b-bf245a0fbe32 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.645941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2520f-c72d-438b-bb3b-bf245a0fbe32 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.645941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 159/303] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:26.647686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2520f-c72d-438b-bb3b-bf245a0fbe32 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.670603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 145/304] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 23:23:26 2022] PUT /identity/v3/system/users/a0fb28f064314364819eac2877b2ea94/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:23:26.670603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.670603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.670603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.691164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:26.692393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:26.771900 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.772870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 146/305] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:26.795038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2520f-c72d-438b-bb3b-bf245a0fbe32 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.800432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.837865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.838587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.838895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.839168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.839929 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:26.840836 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:26.842248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:26.851749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 160/306] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:26.858285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:26.927241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c70f5-9a8c-49cc-97ee-bd244f0135c6 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:26.938858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:26.967053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:26.967913 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:26.969320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:26.969320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:26.969911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:26.971482 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:26.978221 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 147/307] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:26.979526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.000898 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32345406-a1d7-43e6-9056-a0596235e2bc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.046682 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.047520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.047804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.048082 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] PATH_INFO: `/v3/users/c84655247d924479b2bb4bc72b1350f7` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.063601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] RBAC: Authorizing `identity:get_user(user_id=c84655247d924479b2bb4bc72b1350f7)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:27.065154 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850c33-3e6f-4da4-82ed-8cf4895eca99 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:27.066949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 161/308] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:26 2022] GET /identity/v3/users/c84655247d924479b2bb4bc72b1350f7 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:27.068177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231237c3-b1af-4a96-97d9-e84fc9822993 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.068504 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231237c3-b1af-4a96-97d9-e84fc9822993 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.068797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231237c3-b1af-4a96-97d9-e84fc9822993 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.070191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 162/309] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:27.074708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231237c3-b1af-4a96-97d9-e84fc9822993 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.085993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:27.103722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d40477-555f-4473-acf6-0805cf0267c1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.142323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.143005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.143288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.143569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] PATH_INFO: `/v3/groups` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.144259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:27.145752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b4966-ec60-4991-959f-c970be69bdbb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:27.189451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231237c3-b1af-4a96-97d9-e84fc9822993 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.233138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 148/310] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 23:23:26 2022] POST /identity/v3/groups => generated 229 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:23:27.234779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003905-6768-42b8-9828-569193028e71 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.235080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003905-6768-42b8-9828-569193028e71 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.235366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e003905-6768-42b8-9828-569193028e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.235961 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.236740 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.236967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.237251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.238114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, user.id=c84655247d924479b2bb4bc72b1350f7, scope.system=all) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:27.238438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:27.239964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:27.246384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 163/311] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:23:27 2022] GET /identity/v3/role_assignments?user.id=c84655247d924479b2bb4bc72b1350f7&scope.system=all&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:27.268532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7e003905-6768-42b8-9828-569193028e71 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:27.270316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7e003905-6768-42b8-9828-569193028e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:27.312035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:27.362399 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 149/312] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:27.386389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.467185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:27.499037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf73e81-1221-4662-9fa0-f802d8559898 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.535161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.535979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.536272 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.536588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.547030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:27.555401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:27.556525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:27.557761 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 164/313] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:27.562939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003905-6768-42b8-9828-569193028e71 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.674381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e003905-6768-42b8-9828-569193028e71 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.710217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.710910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.711200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.711487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.712250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] RBAC: Adding query filter params (name=reader) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:27.712591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:27.713998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:27.723102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 150/314] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:27.728339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.837198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7876444-3706-4ee1-90f6-a819616c14e9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:27.868266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:27.873949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:27.874854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:27.875142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:27.875418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] PATH_INFO: `/v3/users/e93b54d8487b46389870817daa8369d4` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:27.876783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] RBAC: Authorizing `identity:get_user(user_id=e93b54d8487b46389870817daa8369d4)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:27.878335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:27.880432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 165/315] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:27 2022] GET /identity/v3/users/e93b54d8487b46389870817daa8369d4 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:27.885642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:27.916643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:27.994719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49f28e-40f7-4406-8ab3-c9da64f3b81c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:28.053860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:28.054535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:28.054830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:28.055114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:28.126608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:28.128103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:28.156125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:28.231285 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 151/316] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:28.236808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:28.343714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b45ff-809c-4af7-9f7a-e86b489bcd2a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:28.378644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:28.379793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:28.380248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:28.380714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:28.382115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:28.383743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada7ccc-7e18-4f60-ad6f-084dd0385ba0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:28.385985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 166/317] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:28 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:28.392744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:28.499891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65988-10d5-4e97-9f15-2d46a958ed6c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:28.529836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:28.537695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:28.538366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:28.538651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:28.538931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:28.539772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, scope.project.id=dbc4f41e299a4ef590921493f713f54d, user.id=e93b54d8487b46389870817daa8369d4) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:28.540089 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:28.541575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50997dd5-7fbb-4a25-9de1-6966e7975928 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:28.547865 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 152/318] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:28 2022] GET /identity/v3/role_assignments?user.id=e93b54d8487b46389870817daa8369d4&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:28.806026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b77-0737-4d46-811e-2f3e50bc93ef None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:28.806387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b77-0737-4d46-811e-2f3e50bc93ef None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:28.806517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b77-0737-4d46-811e-2f3e50bc93ef None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:28.808040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 167/319] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:28.813573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:28.813879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:28.814169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:28.835185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:28.836394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:28.906109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 153/320] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:28.929732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b77-0737-4d46-811e-2f3e50bc93ef None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.000509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.036801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b77-0737-4d46-811e-2f3e50bc93ef None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.070729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.071543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.071838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.072122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.082930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:29.092137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:29.093405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:29.094830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:29.100428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 168/321] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:29.100683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.203983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b22b4-f109-4779-8247-193836a5c71a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.227166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.238694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.240610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.240610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.240610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.240880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:29.240962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.242336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.250642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 154/322] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:29.256214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.356807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48ccd5-9e08-4681-b2f6-5a3ad1d41711 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.382667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.391749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.392668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.395104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.395104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] PATH_INFO: `/v3/users/a0fb28f064314364819eac2877b2ea94` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.395104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fb28f064314364819eac2877b2ea94)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.395863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b55494-9b12-4e8d-a27c-9616bd182769 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.397694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 169/323] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/users/a0fb28f064314364819eac2877b2ea94 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:29.403450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.442669 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4be4-2931-4b98-997f-87774ee08681 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.443030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4be4-2931-4b98-997f-87774ee08681 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.443247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f4be4-2931-4b98-997f-87774ee08681 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.444816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 170/324] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:29.449542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d495c3-4752-4faf-a39a-5dc75e4dec4d None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.450327 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d495c3-4752-4faf-a39a-5dc75e4dec4d None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.450615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d495c3-4752-4faf-a39a-5dc75e4dec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.470487 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-18d495c3-4752-4faf-a39a-5dc75e4dec4d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:29.471696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-18d495c3-4752-4faf-a39a-5dc75e4dec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:29.510222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce94a-3d25-459a-acce-3290f5ed00d6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.538994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 171/325] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:29.540302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedaace-d7c5-40be-987a-124b69bcb611 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.540634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedaace-d7c5-40be-987a-124b69bcb611 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.540924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedaace-d7c5-40be-987a-124b69bcb611 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.546189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 172/326] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:29.546327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.546327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.546327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.546327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.547147 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] RBAC: Adding query filter params (role.id=9c32a0917e444135870b906aa819927d, user.id=a0fb28f064314364819eac2877b2ea94, scope.system=all) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:29.547464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.548995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.549979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.550280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.550574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.562296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 155/327] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/role_assignments?user.id=a0fb28f064314364819eac2877b2ea94&scope.system=all&role.id=9c32a0917e444135870b906aa819927d => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:29.563446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.567859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:29.569124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:29.610714 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.647597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 173/328] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:29.671839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.681261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c4fe5-2926-4eab-97ad-c3f176c060b3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.723070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.723895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.724219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.724522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.725815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.727408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.729127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 156/329] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:29.734880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.736188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.784184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8d360-894d-4aeb-a79d-e392236fc1f4 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.818525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.819329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.819620 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.819903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.830171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:29.838150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:29.839426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:29.845641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 174/330] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:29.846651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fab4f-2085-445f-913b-8b30d788e5ee None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.846769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:29.856318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.880901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.881513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.881803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.882087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] PATH_INFO: `/v3/groups` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.882781 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.884241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.943319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f064b-1a27-4be6-901f-e0ed022f0edd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:29.958928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:29.962864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 157/331] 10.222.0.16 () {60 vars in 1134 bytes} [Wed Jun 29 23:23:29 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:23:29.977828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:29.978574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:29.978914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:29.979201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:29.979991 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:29.980309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:29.982354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:29.993146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 175/332] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:29.999879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:30.109939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b4978-95ab-4cfc-9156-075c9434ec64 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:30.146580 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:30.147405 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:30.147699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:30.148001 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] PATH_INFO: `/v3/users/c84655247d924479b2bb4bc72b1350f7` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:30.149299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] RBAC: Authorizing `identity:get_user(user_id=c84655247d924479b2bb4bc72b1350f7)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:30.150737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979382d-d171-420e-a8e2-164ef82f5a8b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:30.152429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 158/333] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:29 2022] GET /identity/v3/users/c84655247d924479b2bb4bc72b1350f7 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:30.158830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:30.266739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834e9da-f204-4fc9-a446-e64631c82b15 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:30.304222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:30.305139 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:30.305431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:30.305717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] PATH_INFO: `/v3/system/users/c84655247d924479b2bb4bc72b1350f7/roles/27c27f88b5e74348aaeb31c943b8508d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:30.307266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c84655247d924479b2bb4bc72b1350f7, role_id=27c27f88b5e74348aaeb31c943b8508d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:30.308699 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986071a-c4ff-4225-9afd-22fb999f5e9d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:30.392678 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 176/334] 10.222.0.16 () {58 vars in 1334 bytes} [Wed Jun 29 23:23:30 2022] PUT /identity/v3/system/users/c84655247d924479b2bb4bc72b1350f7/roles/27c27f88b5e74348aaeb31c943b8508d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:32.220260 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ae2c-6ea7-46d3-9366-501059ea54a4 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.221387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ae2c-6ea7-46d3-9366-501059ea54a4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.221904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79ae2c-6ea7-46d3-9366-501059ea54a4 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.223815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 159/335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:32.228938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.229816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.230354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.251443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:32.253062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:32.305510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:32.342370 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 177/336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:32.379059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79ae2c-6ea7-46d3-9366-501059ea54a4 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:32.438021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:32.514458 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79ae2c-6ea7-46d3-9366-501059ea54a4 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:32.559434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:32.560258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.560582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.560869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.578806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-235e44c0-8455-45c5-8165-62e7c3bf9f7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:32.586812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:32.588017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:32.589151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 160/337] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:32.594027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:32.620219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfbcd-984d-4c26-a23e-b16123bfa459 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.620625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfbcd-984d-4c26-a23e-b16123bfa459 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.620860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cfbcd-984d-4c26-a23e-b16123bfa459 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.623519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 161/338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:32.628606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.628904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.629254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.656436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:32.657677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:32.754739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 162/339] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:32.757010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8d896-8627-4469-a470-392b53b816b2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:32.801765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:32.821876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:32.822582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:32.822875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:32.823162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:32.823937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:32.824256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:32.828012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:32.846215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 178/340] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:32.851561 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:32.854670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:32.914769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:32.985776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319e427-faa0-4592-9bd7-9db182a101b3 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.068774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.069594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.069885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.070164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.077714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812b761-499f-4d82-bf14-6ac2dbe30525 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.098061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:33.111173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:33.112334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:33.113392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:33.120891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 163/341] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:33.123937 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.148502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.149166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.149451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.149735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.280852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:33.281498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.282327 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fa5f-6962-407a-a860-23cda6128aa4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:33.296503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47f7-e06a-4101-9ac2-403f303479ed None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.342261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.344468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.345166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.345471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.345748 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.346623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:33.346940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:33.348330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3ae04-734e-42ee-95f7-17fdb4353042 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:33.364571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 164/342] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:33.365969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fbe0-a9d8-4631-a335-7f28ce379562 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.366267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fbe0-a9d8-4631-a335-7f28ce379562 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.366553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fbe0-a9d8-4631-a335-7f28ce379562 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.372631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 165/343] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:33.373641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0237-1e70-4cad-81a4-ce4e1737bf3e None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.373933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0237-1e70-4cad-81a4-ce4e1737bf3e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.374215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a0237-1e70-4cad-81a4-ce4e1737bf3e None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.375634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 166/344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:33.376610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0237-1e70-4cad-81a4-ce4e1737bf3e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.451465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 179/345] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:33.452795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0bda-a860-4e13-9c7e-c03bda57d74e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.453091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0bda-a860-4e13-9c7e-c03bda57d74e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.453455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f0bda-a860-4e13-9c7e-c03bda57d74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.470508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2b5f0bda-a860-4e13-9c7e-c03bda57d74e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:33.471724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2b5f0bda-a860-4e13-9c7e-c03bda57d74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:33.518489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a0237-1e70-4cad-81a4-ce4e1737bf3e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.548278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 180/346] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:33.549570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.549867 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.550153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.560390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.561441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.561950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.562461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.568724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:33.569927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:33.584056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.635935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.642782 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:33.645367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:33.649182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 181/347] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:33.649182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.758176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 167/348] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:33.759430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.778689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e269c-ebe6-4307-8f24-e951716481a7 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.816691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.817259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.818499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.818790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.819075 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.820286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:33.821791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:33.823822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 182/349] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:33.824670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.872448 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ab46c-d598-4007-8789-964f59c4f7f8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.891594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:33.910920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.912111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.912674 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.913232 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.925171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:33.933771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:33.934851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:33.935892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:33.936715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bf718-c673-4ed5-b50e-8a67264ea1c4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:33.938701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 168/350] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:33.939918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:33.973566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:33.974390 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:33.974679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:33.974959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:33.987138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:33.995233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:33.996583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 183/351] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:33.998265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.060756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cced71-95f4-4114-9bc2-2377364b278e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.072465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.098172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.099974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.100535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.101069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.102512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.104213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.110622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 169/352] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.111801 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.119507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d718362-a6ee-4938-b04f-e42134d24d2d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.143597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.157820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.158712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.158986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.159273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.165952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.167505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.169818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 184/353] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:33 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.170602 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.243902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d6163-0d4d-45e8-915e-2f4a47a58f63 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.293757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.295256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.295756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.296256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.297270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:34.297794 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.299235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85669178-ec0b-4db1-88f9-2bd63b44b3fc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.299827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.310893 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 170/354] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.312042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.345296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.346227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.346641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.346942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.347977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] RBAC: Adding query filter params (name=reader) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:34.348778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.350750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f967e3a-bc88-4621-b0a3-ee900dedde69 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.361520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 185/355] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.362979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65729f10-e893-4d20-8b42-ecff1977b8b2 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.363345 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65729f10-e893-4d20-8b42-ecff1977b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.363633 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65729f10-e893-4d20-8b42-ecff1977b8b2 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.365132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 186/356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:34.365751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65729f10-e893-4d20-8b42-ecff1977b8b2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.366949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.426749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.441690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb7753-1862-47fb-a1ef-bd2f78bab40d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.488369 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.489295 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.489589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.489876 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.491071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.492547 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.497873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 171/357] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.497873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.510825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65729f10-e893-4d20-8b42-ecff1977b8b2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.553834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.554546 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.554840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.555124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.555965 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=9c32a0917e444135870b906aa819927d, scope.project.id=b96dfee913fc4da88a3350a05c943c99) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:34.556282 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.558971 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.570274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 187/358] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=9c32a0917e444135870b906aa819927d => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.570708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.636017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc82d54-e164-4211-8c69-0006fa15078d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.647411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.683056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.684278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.684611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.684895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.718891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818ea9a-724b-4da2-84f4-0743ef5da631 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:34.735994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:34.764438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:34.765344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.765630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.765911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] PATH_INFO: `/v3/users/c84655247d924479b2bb4bc72b1350f7` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.767187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] RBAC: Authorizing `identity:get_user(user_id=c84655247d924479b2bb4bc72b1350f7)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.768738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5abbb1-af1f-4500-9cc6-7eb1b29efaa9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.770752 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 188/359] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/users/c84655247d924479b2bb4bc72b1350f7 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:34.772037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.772330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.772635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.772974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:34.774688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b8a74-e3ca-4792-93f8-5d4a9b39116d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:34.795624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:34.796952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:34.879690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 189/360] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:34.880617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.897484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 172/361] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:34.899341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab02b6-8146-4df6-8ca1-4c9fc9aade55 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:34.899871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab02b6-8146-4df6-8ca1-4c9fc9aade55 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:34.900397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab02b6-8146-4df6-8ca1-4c9fc9aade55 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:34.902264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 173/362] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:34.903368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab02b6-8146-4df6-8ca1-4c9fc9aade55 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:34.921399 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.024887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705193e-0a30-4594-9e0e-d8bb9df1b27e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.038341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.053233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab02b6-8146-4df6-8ca1-4c9fc9aade55 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.068341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.069380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.069535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.070163 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.071009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=9c32a0917e444135870b906aa819927d, scope.project.id=dbc4f41e299a4ef590921493f713f54d) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:35.071331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.073031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.078916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 190/363] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=9c32a0917e444135870b906aa819927d => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.079733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.120168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.120887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.122061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.122061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.122977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] RBAC: Adding query filter params (role.id=27c27f88b5e74348aaeb31c943b8508d, user.id=c84655247d924479b2bb4bc72b1350f7, scope.system=all) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:35.123399 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.125013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.141952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 174/364] 10.222.0.16 () {56 vars in 1308 bytes} [Wed Jun 29 23:23:34 2022] GET /identity/v3/role_assignments?user.id=c84655247d924479b2bb4bc72b1350f7&scope.system=all&role.id=27c27f88b5e74348aaeb31c943b8508d => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.142928 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.210917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dc22c-5bf2-4727-8c5c-c2e91eaa8edc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.227096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.252331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.253040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.253849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.253849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.255033 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.256844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74876f1-1f19-4e32-8052-5d8c109d4c8a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.258693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 191/365] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.260138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.260453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.264825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.272607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f394d-3bbd-4b72-9350-1bbe455e70f0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.284302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:35.285572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:35.314242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.320367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.320367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.320367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.325216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.332605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:35.343825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:35.345228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 175/366] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:35.346436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.367445 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 192/367] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:35.368362 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.528874 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677171ef-4b5d-4d09-baa0-e3df8c891398 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.560011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.563319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c02c5e-2cee-4a1d-8acf-2c8e409ed189 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.570170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.574527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.574527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.574527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.574527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.575156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.576678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 176/368] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.577526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.615620 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.616317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.616695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.616978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.617776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:35.618638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.620344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.633239 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 193/369] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.634214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.681344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:35.737891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf63828-0bdc-44a9-a6c6-206ee8a373db None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.769402 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c54d34-8ee3-4c40-95c4-6149275d3bba None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:35.793375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.794584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.795615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.795917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.810084 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:35.810836 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:35.811579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:35.811943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:35.812296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:35.813238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=b96dfee913fc4da88a3350a05c943c99) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:35.813632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:35.815171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:35.818039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:35.819922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 177/370] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:35.821162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.828758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 194/371] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:35.836165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:35.944828 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.036837 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64b9b1-5f05-43de-88a2-a7993ee90a05 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.050174 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.054215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8233f-37e4-4acf-aa74-7cfba3a720d2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.079321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.080158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.080594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.080988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.104042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.104770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.105058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.105343 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.106158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:36.106456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.107843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.117588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 195/372] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:36.125299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:36.174606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.176641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.232111 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05b856-bdb6-4832-a41c-aa056dad44d7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.239402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.267703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.268510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.268798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.269078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.294814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 178/373] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:36.305519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:36.317337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.397874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.399375 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.473650 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc674d-b2a3-40d3-8371-0e5bfa9cd620 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.553624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.554521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.554813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.555096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.557749 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.559742 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.562739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 179/374] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:36.567490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:36.607631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 196/375] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:36.613366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.613675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:36.728771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:36.768972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef0e346-7b0c-493e-b74f-13614ef97790 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.787750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233914b-eb20-47ba-ad31-52477082bc2e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:36.829025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.829909 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.830195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.830475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] PATH_INFO: `/v3/projects/18ad7aca62a34f47abfc76d765429cb6` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.831695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] RBAC: Authorizing `identity:get_project(project_id=18ad7aca62a34f47abfc76d765429cb6)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.833711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.835793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 197/376] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/projects/18ad7aca62a34f47abfc76d765429cb6 => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:36.841796 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:36.861532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:36.862412 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:36.862702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:36.862984 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:36.864889 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:36.866336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:36.868234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 180/377] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:36.875673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:37.027042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:37.037773 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091a831-8cf8-4f50-b80e-156440d07164 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:37.042786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce316ce2-daac-40d6-add2-fe0910a9b624 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:37.079911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:37.080538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.080831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.081113 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.081952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=dbc4f41e299a4ef590921493f713f54d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:37.082268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:37.084007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:37.105893 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 181/378] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:37.120838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:37.126338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:37.127255 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.127546 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.127831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] PATH_INFO: `/v3/groups/bf49934167f34ab58dd5a0fe08634ec6` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.136791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] RBAC: Authorizing `identity:get_group(group_id=bf49934167f34ab58dd5a0fe08634ec6)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:37.138898 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943abb10-a46e-48ea-a7c1-9f7cefdf1e5c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:37.141115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 198/379] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:36 2022] GET /identity/v3/groups/bf49934167f34ab58dd5a0fe08634ec6 => generated 229 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:37.146921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:37.168379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f6b9-e1b5-403a-9be4-527ce100ffa1 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.168776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f6b9-e1b5-403a-9be4-527ce100ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.168984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127f6b9-e1b5-403a-9be4-527ce100ffa1 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.170666 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 199/380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:37.176711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.177053 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.177282 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.207881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:37.210192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:37.340619 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec4bfa-4672-4a96-b6ec-111765843663 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:37.358115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 200/381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:37.378864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:37.379830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.380289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.380756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.381757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] RBAC: Adding query filter params (group.id=bf49934167f34ab58dd5a0fe08634ec6, role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=18ad7aca62a34f47abfc76d765429cb6) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:37.382254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:37.383936 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:37.390812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 182/382] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:37 2022] GET /identity/v3/role_assignments?group.id=bf49934167f34ab58dd5a0fe08634ec6&scope.project.id=18ad7aca62a34f47abfc76d765429cb6&role.id=d47785af145640e9b0d7553f25d48899 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:37.395712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:37.516443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5fe9c-61ef-41e1-bde8-080ddb2f86e5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:37.544385 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:37.562202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d24159-696d-45de-9589-c8141196d273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:37.564731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24159-696d-45de-9589-c8141196d273 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.564731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24159-696d-45de-9589-c8141196d273 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.564731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d24159-696d-45de-9589-c8141196d273 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.576314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d24159-696d-45de-9589-c8141196d273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-70d24159-696d-45de-9589-c8141196d273 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:37.588713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:37.589877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:37.590964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 201/383] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:37.596686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:37.627791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:37.734890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25248c23-dc96-4bed-b714-d3ec9cb4ff35 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:37.775551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eddb0-cc9c-42cc-838d-f9bc11b871c9 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.775903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eddb0-cc9c-42cc-838d-f9bc11b871c9 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.776093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858eddb0-cc9c-42cc-838d-f9bc11b871c9 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.778197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 202/384] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:37.783235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.783535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.783818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.784010 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:37.784597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:37.784893 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:37.785180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:37.785948 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:37.786263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:37.787681 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:37.800022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 183/385] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:37.805727 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:37.820892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:37.822085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:37.965594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 203/386] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:37.968844 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:37.989343 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b84f6-fdbf-4231-8999-40c5468718c8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.009816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.056066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.057891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.058181 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.058462 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.065332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.067067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.069222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 184/387] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:37 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:38.075190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.171173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72ac2-6685-44b2-8472-8edf5c053715 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.187718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:38.219866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.220842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.221323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.221615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.241574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:38.247795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef271-a1a7-41c9-9704-aa2dff1b6d16 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:38.250124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:38.252395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:38.254658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 204/388] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:38.261369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.289578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.290464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.290760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.291042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.293841 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.295314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.297450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 185/389] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:38.303107 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.332849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:38.421162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3faf6b-5760-4dcf-9e06-cd5b045d3297 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.454375 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b67612-1b8b-4be7-9d31-494d11a05789 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.459583 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.460525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.460823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.461114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/9c32a0917e444135870b906aa819927d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.463182 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, group_id=5148d6ca19b04f759a23e6f0cbb0a11a, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.465672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d306800-b9a4-4720-a842-6f39a40e46b3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.498439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.499083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.499376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.499661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.500559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:38.500875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.503392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.513985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 205/390] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:38.519219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.564967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:38.587599 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 186/391] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:23:38 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:38.646364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c741d-9ac1-477e-903b-3c74df7c682c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.686810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ef48-4009-4d5d-a3c4-4bcb06b21adf None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.687375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ef48-4009-4d5d-a3c4-4bcb06b21adf None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.687375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98ef48-4009-4d5d-a3c4-4bcb06b21adf None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.688780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 187/392] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:38.689389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.690488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.690942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.691389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.692969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.694687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.701079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 206/393] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:38.703564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.703985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.704397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.707209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.733491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:38.734734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:38.878489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 188/394] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:38.890467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236c3a6-fffb-4950-9316-b6e13460b6c7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:38.892087 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:38.903556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:38.915220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:38.937351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:38.938819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:38.942794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:38.942794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:38.942794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:38.943968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:38.946594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 207/395] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:38.952667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:39.041212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25261a4-c939-40e3-91ba-701aa014ed62 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.075167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7403e6-82b4-4645-816e-c7e9db3161c4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.082751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.083970 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.085449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.085988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.099258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:39.110629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:39.111757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:39.112812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:39.117224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 189/396] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:39.124286 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:39.124947 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.126687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.127423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.128159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/9c32a0917e444135870b906aa819927d` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.130646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, group_id=5148d6ca19b04f759a23e6f0cbb0a11a, role_id=9c32a0917e444135870b906aa819927d)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:39.133456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:39.205844 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:39.224112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 208/397] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:23:38 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/9c32a0917e444135870b906aa819927d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:39.248364 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c750a72-4a26-412b-a126-3c71a2bf7dc0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.288969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.289676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.289971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.290257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.291042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:39.291418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:39.292945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:39.303373 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 190/398] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:39.309755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:39.384921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:39.422359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d31f-ad02-4e81-8579-7d40edaa5216 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.460821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.461720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.462010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.462294 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.463637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:39.465699 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:39.468154 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 209/399] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:39 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:39.473805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:39.585107 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc912b-7889-4073-9d02-e8404a0158d4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.613256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:39.622642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.623530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.627513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.627513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.627513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:39.627513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1f8e2-952b-4be5-bce6-32e3824a2063 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:39.629048 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 191/400] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:39 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:39.637999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:39.761110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:39.765335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c452f0-afc5-4e01-b5d2-051fd82e3168 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:39.800554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:39.801450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.801746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.802126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.804338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfee913fc4da88a3350a05c943c99, group_id=5148d6ca19b04f759a23e6f0cbb0a11a, role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:39.805834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:39.807971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c000b-909f-4381-aef3-5eb6ea6a0f95 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.808549 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c000b-909f-4381-aef3-5eb6ea6a0f95 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.809406 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c000b-909f-4381-aef3-5eb6ea6a0f95 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.810545 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 192/401] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:39.822129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:39.822426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:39.822719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:39.840751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:39.841953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:39.907391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 210/402] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:23:39 2022] PUT /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:39.925470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 193/403] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:39.953080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.098619 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f426dac-19a6-4b75-aafe-4bf8d441ff65 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.130110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.131000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.131289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.131628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.143296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6651eaf7-2872-43e4-ab40-d6ed7a538195 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:40.151532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:40.154358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:40.156701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 211/404] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:40.161641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.187901 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d1da-b369-40a4-8da3-3cd27deb8340 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.188244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d1da-b369-40a4-8da3-3cd27deb8340 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.188483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87d1da-b369-40a4-8da3-3cd27deb8340 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.190222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 212/405] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:40.195698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.195972 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.196322 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.218177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:40.219783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:40.240443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:40.291203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d74de-75a3-4f6b-ba46-5a3d3d54a3fa None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.322109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 213/406] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:40.333492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:40.350729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.362294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.364321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.365000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.366131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.367236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:40.369148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:40.371670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:40.388818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 194/407] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:40.396377 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.504735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b319-3a97-4829-9602-a8e1e36d1283 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.562144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d72cb2-3324-487b-85b1-25873313e3d3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.567453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.568281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.568597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.568879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.580483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:40.588757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:40.589837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:40.591418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 214/408] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:40.605892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.618066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.618945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.619231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.619513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.622480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:40.623934 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:40.626849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 195/409] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:40.632164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.638150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:40.700315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:40.745691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2cf4f-06b7-49fe-b152-b7b25be7e325 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.782356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.783633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.783770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.784139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.785510 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:40.787040 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:40.789284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 196/410] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:40.795854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.813268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fbe713-85a8-423d-9c64-b690629855e2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.881042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.882125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.882649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.883150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.884142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:40.884714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:40.886342 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:40.904786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 215/411] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:40.913654 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:40.920551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a217a-0439-43c0-b56a-38af0572ec39 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:40.956792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:40.960246 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:40.961864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:40.962255 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:40.962606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:40.967479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dbc4f41e299a4ef590921493f713f54d, group_id=5148d6ca19b04f759a23e6f0cbb0a11a, role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:40.972636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:41.020330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:41.053486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4702b-e80a-43f5-8984-3faa562ac2b9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:41.066149 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 197/412] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:23:40 2022] PUT /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d/groups/5148d6ca19b04f759a23e6f0cbb0a11a/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:23:41.119605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:41.120518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.120803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.121082 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] PATH_INFO: `/v3/groups/bf49934167f34ab58dd5a0fe08634ec6` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.123165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] RBAC: Authorizing `identity:get_group(group_id=bf49934167f34ab58dd5a0fe08634ec6)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:41.124651 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:41.127592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 216/413] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:40 2022] GET /identity/v3/groups/bf49934167f34ab58dd5a0fe08634ec6 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:41.132620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:41.250197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b41b1-398d-4390-b05e-6e3970fa6ce4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:41.287453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:41.288355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.288675 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.288959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] PATH_INFO: `/v3/projects/18ad7aca62a34f47abfc76d765429cb6` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.290241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] RBAC: Authorizing `identity:get_project(project_id=18ad7aca62a34f47abfc76d765429cb6)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:41.291852 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06420d-7470-4f15-9a65-e91806495e63 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:41.299152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 198/414] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:41 2022] GET /identity/v3/projects/18ad7aca62a34f47abfc76d765429cb6 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:41.300551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:41.386324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c76e-c217-47e4-867e-4bfb74ed9d47 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.386689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c76e-c217-47e4-867e-4bfb74ed9d47 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.386951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c76e-c217-47e4-867e-4bfb74ed9d47 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.389547 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 199/415] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:41.394761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.395054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.395446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.409852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f589f9-8b81-4db6-9cd5-ed9b65d90136 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:41.415489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:41.416737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:41.451134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:41.452663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.453025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.453309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] PATH_INFO: `/v3/projects/18ad7aca62a34f47abfc76d765429cb6/groups/bf49934167f34ab58dd5a0fe08634ec6/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.455616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] RBAC: Authorizing `identity:create_grant(project_id=18ad7aca62a34f47abfc76d765429cb6, group_id=bf49934167f34ab58dd5a0fe08634ec6, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:41.458189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:41.474453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:41.497075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 200/416] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:41.521582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:41.530430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:41.537293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 217/417] 10.222.0.16 () {58 vars in 1442 bytes} [Wed Jun 29 23:23:41 2022] PUT /identity/v3/projects/18ad7aca62a34f47abfc76d765429cb6/groups/bf49934167f34ab58dd5a0fe08634ec6/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:23:41.637665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0583-9a27-4f58-9cb8-2f30ac321b43 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:41.678069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:41.678908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.679198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.679478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.692261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-df4dcc9e-be82-4793-b1e8-4c2f5d4bc11c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:41.700608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:41.701819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:41.702821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 201/418] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:41.708167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:41.723807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7214ce-f130-4ab8-b362-50a5d1041427 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.724166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7214ce-f130-4ab8-b362-50a5d1041427 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.724378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7214ce-f130-4ab8-b362-50a5d1041427 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.726063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 202/419] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:41.731501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.731779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.732054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.752028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:41.753578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:41.796908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:41.845600 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 203/420] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:41.850326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0178a-e992-4654-93aa-d691501e0e5f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:41.903317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:41.903529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:41.904278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:41.904610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:41.904895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:41.905993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] RBAC: Adding query filter params (name=member) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:41.906309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:41.907704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:41.918722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 218/421] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:41.924584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.032828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.042785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04071c-7d9f-4c61-9a9c-3edb8c8e3a8e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:42.080001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc19f6f-c501-4b36-9022-fa7fe938e191 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:42.110418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:42.111242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.111531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.111809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.130948 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:42.139185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:42.140278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 29 23:23:42.141297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:42.143204 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 204/422] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:42.154929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.156396 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:42.157097 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.157389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.157670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.207852 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.296932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:42.298436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:42.338463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de77cfd-6658-4c72-9df8-158a7f2e8dd5 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:42.405731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:42.406340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.406630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.406915 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.407679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:42.407994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:42.409434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:42.416775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.433255 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 205/423] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:42.436804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.498555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 219/424] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:42.503943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.561424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.567818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443f748-2622-4e61-83d2-839371186c8c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:42.633461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:42.634121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.634409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.634688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.722673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:42.724054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9b3c1-545a-4f58-b5cd-9821df3939fb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:42.730281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8ef0-152e-449c-b723-54453b7dd7fc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:42.792863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:42.794058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.794355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.794959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.797105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:42.798587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259d48-bdf4-4878-9889-4e12a71128a9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:42.800703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 220/425] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:42 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:42.802610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f590-c8b9-429d-9f00-984d5a63389f None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.803361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f590-c8b9-429d-9f00-984d5a63389f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.803668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29f590-c8b9-429d-9f00-984d5a63389f None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.805453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 221/426] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:42.808823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29f590-c8b9-429d-9f00-984d5a63389f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.825810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.833921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 206/427] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:42.842625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:42.842625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:42.842625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:42.845695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:42.858843 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:42.860032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:42.940009 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 207/428] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:42.940999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:42.962984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29f590-c8b9-429d-9f00-984d5a63389f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.004071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.004903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.005185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.005460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.006665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.008238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.010396 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 222/429] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:42 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:43.011247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.084805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3c0cc-bbc0-4bfe-a795-884bf0ab6069 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.117739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.123690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.124917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4456-5f04-43a7-b54d-aec7c496ac35 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.138594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.140206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.140729 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.141478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.143037 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.145033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.147373 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 208/430] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:42 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:43.148482 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.166803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.167794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.168182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.168586 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.180200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:43.190722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:43.192029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:43.193308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:43.194228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 223/431] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:43.194968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.276041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ccde14-b82c-430d-b327-e5989b2aafbb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.313264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.314021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.314555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.315016 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.316084 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=9c32a0917e444135870b906aa819927d, scope.project.id=b96dfee913fc4da88a3350a05c943c99) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:43.316606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.318331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.324853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c1c18-f10e-4521-b1c7-c1ada1b6a838 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.325244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 209/432] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=9c32a0917e444135870b906aa819927d => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:43.326318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.370785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.372571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.373032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.373477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.375044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.376783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.379048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 224/433] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:43.385104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.405971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.413766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.470522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca7b6d-47f5-44bf-a2d0-b20c8f343eca None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.509634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.510593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.511075 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.511530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.511665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb52079-138e-436a-a1e0-1cf0c3e5599a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.512900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:43.513426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.514994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.524879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 210/434] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:43.529986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.578942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.579966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.580566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.580856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.581708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=9c32a0917e444135870b906aa819927d, scope.project.id=dbc4f41e299a4ef590921493f713f54d) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:43.582029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.583522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8075ba-30ea-44d5-9300-6538e32bb247 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.591317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 225/435] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=9c32a0917e444135870b906aa819927d => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:43.592909 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe3e8-a7d2-4118-a586-bbee9ede4449 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.593368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe3e8-a7d2-4118-a586-bbee9ede4449 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.593830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fe3e8-a7d2-4118-a586-bbee9ede4449 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.595789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 226/436] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:43.601903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.602451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.602940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:43.626885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:43.693321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc708d31-795d-47b8-9353-9a741c807e06 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.717109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 227/437] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:43.718566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.738183 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697482-8703-461c-a765-596590eb633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.739194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697482-8703-461c-a765-596590eb633b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.739716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697482-8703-461c-a765-596590eb633b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.748742 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697482-8703-461c-a765-596590eb633b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.748951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.778214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:43.832452 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48697482-8703-461c-a765-596590eb633b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:43.834219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48697482-8703-461c-a765-596590eb633b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:43.892306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11db8ac-59cb-4b31-9fb8-8871f7baf0d2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:43.941211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:43.942038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:43.942325 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:43.945341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:43.957450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:43.965549 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 211/438] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:43.967167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:43.968336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:43.975921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 228/439] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:43.976873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697482-8703-461c-a765-596590eb633b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.978305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:43.996336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.078500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.094808 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697482-8703-461c-a765-596590eb633b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.102725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c44221-5538-456c-92f4-bc95aae8f47a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.128705 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.129575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.129862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.130143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] PATH_INFO: `/v3/projects/b96dfee913fc4da88a3350a05c943c99` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.131327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] RBAC: Authorizing `identity:get_project(project_id=b96dfee913fc4da88a3350a05c943c99)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.132800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b3d66-8254-4b0e-824e-ac3c8214b048 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.134486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 212/440] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/projects/b96dfee913fc4da88a3350a05c943c99 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.135728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f73f8-b1fa-40b3-91bd-272e4b3e7e49 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.136019 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f73f8-b1fa-40b3-91bd-272e4b3e7e49 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.136215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.136365 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f73f8-b1fa-40b3-91bd-272e4b3e7e49 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.137702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.137998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.138470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.138594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 213/441] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:44.139126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:44.139456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.140814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a865c-43a2-48d5-9173-23ce84aeea3b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.140942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f73f8-b1fa-40b3-91bd-272e4b3e7e49 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.154339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 229/442] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.154339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.154339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.154339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.167587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:44.169808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:44.229230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.237900 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 230/443] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:44.238735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.246552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f73f8-b1fa-40b3-91bd-272e4b3e7e49 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.283497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.284370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.284700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.284978 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.286168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.287608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.289264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 214/444] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:44.290021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.312824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.343891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160a3ef-3b16-404c-9ff0-54f58e99cc52 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.377679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.378271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.378565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.378851 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.388847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11285a43-c26a-4482-8ce3-8b8d4737c38c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.423467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.424267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.424602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.424887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.435659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:44.443273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:44.444614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 215/445] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:44.445830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.451036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.452548 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.462844 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.520646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.546159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766cb3bb-85ad-472b-b794-e7ff5b8ec89e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.550493 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 231/446] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:44.551314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.581417 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.582093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.582384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.582667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.583535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=b96dfee913fc4da88a3350a05c943c99) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:44.583854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.585426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.591217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 216/447] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=b96dfee913fc4da88a3350a05c943c99&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.591997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.671522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff3d4a-87bc-47c2-aa79-664a43a78f66 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.686919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.710763 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912f4bf-7a74-40a9-9d7c-8a770b0c84ff None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.711388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.712134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.712722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.713077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.714760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:44.715115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.716618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.732684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 232/448] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.734626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.750553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.751825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.752172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.752495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] PATH_INFO: `/v3/projects/dbc4f41e299a4ef590921493f713f54d` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.753896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] RBAC: Authorizing `identity:get_project(project_id=dbc4f41e299a4ef590921493f713f54d)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.755349 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.757128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 217/449] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/projects/dbc4f41e299a4ef590921493f713f54d => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.763507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.778997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.857095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258693b-54a8-441c-8f47-9e12b5ab63ba None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.885391 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fc84b-4ae8-4bac-8b44-7d209c17cf7b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:44.900038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fa855-766e-4bc5-a985-265058504073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.900733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fa855-766e-4bc5-a985-265058504073 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.901027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fa855-766e-4bc5-a985-265058504073 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.901307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fa855-766e-4bc5-a985-265058504073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.924081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:44.925407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:44.925407 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:44.925648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] PATH_INFO: `/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:44.926681 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] RBAC: Authorizing `identity:get_group(group_id=5148d6ca19b04f759a23e6f0cbb0a11a)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.929581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:44.930128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 218/450] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/groups/5148d6ca19b04f759a23e6f0cbb0a11a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:44.937079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:44.956379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:44.986482 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fa855-766e-4bc5-a985-265058504073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:44.988015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fa855-766e-4bc5-a985-265058504073 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:45.023672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:45.061926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d711e2a-e293-49c8-a12e-65cd326d9e56 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:45.103129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:45.103784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:45.104077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:45.104363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:45.105242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] RBAC: Adding query filter params (group.id=5148d6ca19b04f759a23e6f0cbb0a11a, role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=dbc4f41e299a4ef590921493f713f54d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:45.106108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:45.107556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:45.114854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 219/451] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/role_assignments?group.id=5148d6ca19b04f759a23e6f0cbb0a11a&scope.project.id=dbc4f41e299a4ef590921493f713f54d&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:45.119745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 233/452] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 29 23:23:45.126232 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:45.211363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:45.233931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8f09a-7253-43e7-bf48-cd80b74beb4d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:45.269416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:45.270294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:45.270581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:45.270859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] PATH_INFO: `/v3/projects/18ad7aca62a34f47abfc76d765429cb6` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:45.272067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] RBAC: Authorizing `identity:get_project(project_id=18ad7aca62a34f47abfc76d765429cb6)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:45.273655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:45.275372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 220/453] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:23:45 2022] GET /identity/v3/projects/18ad7aca62a34f47abfc76d765429cb6 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:45.281647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fa855-766e-4bc5-a985-265058504073 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:45.383436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fa855-766e-4bc5-a985-265058504073 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:45.413037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:45.417845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:45.419245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:45.419530 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:45.419809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] PATH_INFO: `/v3/groups/bf49934167f34ab58dd5a0fe08634ec6` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:45.421122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] RBAC: Authorizing `identity:get_group(group_id=bf49934167f34ab58dd5a0fe08634ec6)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:45.425252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c12234-800f-41e6-b974-ccd5ac0a2376 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:45.425252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 234/454] 10.222.0.16 () {56 vars in 1180 bytes} [Wed Jun 29 23:23:45 2022] GET /identity/v3/groups/bf49934167f34ab58dd5a0fe08634ec6 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:45.430188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:45.530014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca93af-5c8f-492a-8c22-576e2d51cce1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:45.561559 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:45.562211 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:45.562497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:45.562777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:45.563596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] RBAC: Adding query filter params (group.id=bf49934167f34ab58dd5a0fe08634ec6, role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=18ad7aca62a34f47abfc76d765429cb6) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:45.563910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:45.565381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca8dc87-6c58-4a50-9845-e22f4c936e13 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:45.571005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 221/455] 10.222.0.16 () {56 vars in 1376 bytes} [Wed Jun 29 23:23:45 2022] GET /identity/v3/role_assignments?group.id=bf49934167f34ab58dd5a0fe08634ec6&scope.project.id=18ad7aca62a34f47abfc76d765429cb6&role.id=d47785af145640e9b0d7553f25d48899 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:47.949066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977cff-544c-4b4e-8c00-5a74021eb03b None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:47.950257 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977cff-544c-4b4e-8c00-5a74021eb03b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:47.950809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59977cff-544c-4b4e-8c00-5a74021eb03b None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:47.953008 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 235/456] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:47.959502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b0d7-2645-4ca7-9e8b-e9af0dc2772d None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:47.960438 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b0d7-2645-4ca7-9e8b-e9af0dc2772d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:47.960924 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b0d7-2645-4ca7-9e8b-e9af0dc2772d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:47.989775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ff10b0d7-2645-4ca7-9e8b-e9af0dc2772d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:47.991391 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ff10b0d7-2645-4ca7-9e8b-e9af0dc2772d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:47.995329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:48.086065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 222/457] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:48.127695 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59977cff-544c-4b4e-8c00-5a74021eb03b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.228387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe1e3-bae3-49b2-aabb-6cca52e5814c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.229086 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe1e3-bae3-49b2-aabb-6cca52e5814c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.229594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe1e3-bae3-49b2-aabb-6cca52e5814c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.232182 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 223/458] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:48.236737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4ea6-0ff4-4b0e-811b-1e83ffb37917 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.237282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4ea6-0ff4-4b0e-811b-1e83ffb37917 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.237796 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f4ea6-0ff4-4b0e-811b-1e83ffb37917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.254930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c58f4ea6-0ff4-4b0e-811b-1e83ffb37917 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:48.256477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c58f4ea6-0ff4-4b0e-811b-1e83ffb37917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:48.302149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59977cff-544c-4b4e-8c00-5a74021eb03b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:48.339258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 224/459] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:48.363472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:48.364721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.365222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.365729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.381181 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:48.383007 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:48.384961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3495de-ccdc-446c-b46d-3d4e78a48b11 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.385477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3495de-ccdc-446c-b46d-3d4e78a48b11 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.386061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3495de-ccdc-446c-b46d-3d4e78a48b11 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.388017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 225/460] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:48.393907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.394496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.395020 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:48.412600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:48.413794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:48.414866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:48.414866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:48.414866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.414866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:48.414866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 236/461] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:48.415221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.421792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:48.423185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:48.484941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:48.497690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:48.504593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 226/462] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:48.513470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.554725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5a57b-d4ca-4e5a-813e-969637cc066f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:48.602280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:48.603896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.604647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.605172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.619877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:48.622524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:48.643317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1439433-4aaa-4af7-9a50-c6f4e2fdd5f6 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:48.645926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:48.646988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 237/463] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:48.653625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.695513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:48.696349 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.696768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.697208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.699071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:48.700015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:48.701594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:48.721838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 227/464] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:48.721838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.779534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98befd06-14e5-4adf-a84f-81969bd07329 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:48.783225 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:48.798826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:48.820550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:48.821715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.822196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.822656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.837589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:48.839420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:48.851651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec2a28-fcdd-4f73-b9b7-e6acb1f6f36e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:48.862994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:48.864030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:48.865161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:48.865161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:48.865161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:48.865161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:48.868543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 238/465] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:48.869694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.900025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:48.901687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:48.902178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:48.902883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:48.904154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:48.905060 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:48.907159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:48.923030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 228/466] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:48.924194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:48.986072 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72311da-03e4-4ed7-b1a5-eec964d2fe99 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.024861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.025544 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.025838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.026121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.026839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.028360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d30415-3831-44ec-9703-58e018ca2489 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.034818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606eac88-c7c3-41af-9908-7da0eceba753 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.056706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.070920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.071594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.071878 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.072157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.072912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:49.073224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.075230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.086347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 229/467] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:49.087130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:49.102213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 239/468] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:48 2022] POST /identity/v3/users => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:49.103856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc85e1-b28d-490f-bb8a-ca0aab61dccf None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.104358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc85e1-b28d-490f-bb8a-ca0aab61dccf None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.104892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc85e1-b28d-490f-bb8a-ca0aab61dccf None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.106751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 240/469] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:49.107769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc85e1-b28d-490f-bb8a-ca0aab61dccf None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:49.132887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.217919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8c390-72d4-4c52-b969-52dee7dc8e5a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.257632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.258373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc85e1-b28d-490f-bb8a-ca0aab61dccf None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.258982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.259513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.260170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.261288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.263754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cc841a-cdd6-45e7-b296-dc48724d2edc None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.305148 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.306129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.306129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.306355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.307005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.308499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.346736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 230/470] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:49 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:49.348040 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6f31-33b7-4a34-83a6-45e5ab482581 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.348341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6f31-33b7-4a34-83a6-45e5ab482581 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.348725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d6f31-33b7-4a34-83a6-45e5ab482581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.370124 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-461d6f31-33b7-4a34-83a6-45e5ab482581 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:49.371902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-461d6f31-33b7-4a34-83a6-45e5ab482581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:49.410232 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 241/471] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:49 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:49.414392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.475119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 231/472] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:49.510460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:49.549567 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02892b-c80b-4a0a-a9ab-5649ebc67572 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.549891 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02892b-c80b-4a0a-a9ab-5649ebc67572 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.550156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02892b-c80b-4a0a-a9ab-5649ebc67572 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.551838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 232/473] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:49.557081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.557296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.557584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.579818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:49.581070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:49.603219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.659838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462687c3-9dcf-4f76-a712-aa083306861a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.672968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 233/474] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:49.698308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.700026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.700547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.700989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.702092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:49.722447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.723934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:49.748388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:49.749550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:49.750609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:49.750609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:49.750609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:49.750609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:49.753517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 242/475] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:49.759241 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:49.843536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.850941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b247b-71e3-493b-a76d-fe6256529eb2 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.914756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.915449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.915739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.916022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.916813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.919008 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1e9c-724a-4ed6-b847-5039ac2770b6 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:49.921642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.948667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:49.959841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:49.960626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:49.960969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:49.961258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:49.963070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.sql.core [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:23:49.963070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 23:23:49.963070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [parameters: {'id': '81067c38389840daa07e062141838b6e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 23:23:49.963070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=285931) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:23:49.974831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:49.975243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:49.976712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application result.read() Jun 29 23:23:49.988689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return ref.to_dict() Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:23:49.989826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application yield resource Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise self.value Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application session.commit() Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:23:49.992557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:23:49.994824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:23:49.999118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application result.read() Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:23:50.001847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [parameters: {'id': '81067c38389840daa07e062141838b6e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:50.005000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 29 23:23:50.007245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:50.014698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 234/476] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:23:49 2022] POST /identity/v3/roles => generated 144 bytes in 289 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:50.014848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 243/477] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:50.015359 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:50.015525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:50.143505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ece00-4616-4e9f-bbf2-88c24d571c61 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:50.181431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:50.182212 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:50.182611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:50.182895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:50.184175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:50.185919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9417d-b621-4231-a08c-74c92d934de9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:50.191196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a896a-3cdd-418c-8c4d-d473789e0518 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:50.234157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:50.234985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:50.235274 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:50.235556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:50.247271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:50.255670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:50.260942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:50.261990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 235/478] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:23:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:50.264098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:50.283660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 244/479] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:50 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:50.296364 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:50.386488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50daca-5c0a-4374-b208-a9a1b3109593 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:50.428695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:50.429684 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:50.430143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:50.430625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:50.431576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:50.432079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:50.433781 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a94f00-3095-4eb0-bc72-64c270a6619e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:50.445962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 236/480] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:51.635952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303226-ba61-4aa3-a935-5719499abf3e None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:51.636547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303226-ba61-4aa3-a935-5719499abf3e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:51.636547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303226-ba61-4aa3-a935-5719499abf3e None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:51.638997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 245/481] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:51.644268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:51.644752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:51.644942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:51.662829 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:51.664045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:51.748842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 237/482] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:51.773673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b303226-ba61-4aa3-a935-5719499abf3e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:51.813077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:51.891913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b303226-ba61-4aa3-a935-5719499abf3e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:51.926893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:51.927706 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:51.927995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:51.928280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:51.939603 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a8b21ae4-3af1-4345-af3f-7fb73ea5c170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:51.947665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:51.949030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:51.950636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 246/483] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:51.955678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:51.970574 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:51.985969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27170b7-79fa-45c1-8934-d8db3dd206f0 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:51.986263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27170b7-79fa-45c1-8934-d8db3dd206f0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:51.986556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27170b7-79fa-45c1-8934-d8db3dd206f0 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:51.988067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 247/484] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:52.001730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.002023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.002306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.020473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:52.022210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:52.101516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820ff6-6bb0-46f9-85ca-bc5fc88d3c5e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.145150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.145761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.146052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.146336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.147108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:52.147421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.148847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.159188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 248/485] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:52.162970 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 238/486] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:52.173448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.184772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.220762 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.285240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.302488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70050211-32d8-4f52-a6de-8628c8ca92a5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.312161 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8ca1c-b3c2-4ad8-8c9c-f6a104f18ded None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.340841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.341999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.342612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.343123 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.348317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.349247 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.349539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.349819 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.355212 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.357575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.361394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a6fd93e5-a0d7-460d-8a6d-687d9694a099 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:52.369435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:52.370560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:52.372111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:52.376003 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 239/487] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:52.377337 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27ca5-270f-4deb-b4c0-1ec588a5da32 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.377630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27ca5-270f-4deb-b4c0-1ec588a5da32 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.377913 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d27ca5-270f-4deb-b4c0-1ec588a5da32 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.383260 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 240/488] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:52.383260 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d27ca5-270f-4deb-b4c0-1ec588a5da32 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-14663b7d-53ae-4c61-91d2-58befe2523a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:52.385630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:52.386702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:52.388060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:52.388060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:52.388060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:52.388060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:52.390376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 249/489] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:52.391818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.392421 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.392918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.410960 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:52.412598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:52.492624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d27ca5-270f-4deb-b4c0-1ec588a5da32 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.493064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 250/490] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:52.494145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.514048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.528210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.529561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.530028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.530465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.531434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:52.531913 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.533976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.537581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.546535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 241/491] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:52.551971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.649969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad5ac-b4e0-4231-87d6-22d368e5f236 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.659099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921bab0-b56d-49fb-bebc-980471305e06 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.695554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.696146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.696460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.696763 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.697485 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:52.697791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.699208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.700760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.701823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.702350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.702876 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.712338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 251/492] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:52.713190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.715564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:52.725805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:52.726955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:52.727960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:52.731581 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 242/493] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:52.732644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.796032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.797542 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:52.831680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd101b-a5cb-48db-ac2e-cedaee25dedb None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.855949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50120440-767f-4e06-b625-a542909d40f2 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:52.866869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.867689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.867980 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.868267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.879508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.880999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.899802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:52.900953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:52.901151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:52.902162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 252/494] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:52.903765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:52.909270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:52.909425 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:52.920148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:52.921669 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:23:52.943066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:52.945117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 243/495] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:52.946593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.039162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7811863-b4ae-4ec6-bd12-54366c62e0df None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.059109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.074541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.075219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.075509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.075788 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.076603 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:53.076919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.078307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b1dd7-d20d-45f9-9c71-5aff88f9a75a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.080071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff664c-57d8-4114-bb63-762091dfff73 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.091826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 253/496] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:53.091826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5167-cdbe-4200-bb3c-cf7cf48a95b5 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.091826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5167-cdbe-4200-bb3c-cf7cf48a95b5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.091826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c5167-cdbe-4200-bb3c-cf7cf48a95b5 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.095292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 254/497] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:53.096384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5167-cdbe-4200-bb3c-cf7cf48a95b5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.105561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.124162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.124885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.125176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.125461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.126194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:53.126539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.127977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.140895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 244/498] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:53.141701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.203426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c5167-cdbe-4200-bb3c-cf7cf48a95b5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.237547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.238221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.238510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.238796 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.239638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:53.239974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.241458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb7b1e-2435-4968-93d2-1ef3b19b8d05 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.243002 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b78203-b2cc-4618-9229-10514a29af89 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.276965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.277944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 255/499] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:53.278353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.278640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.278954 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.279192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.279491 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.279780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.290977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.292591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.295556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:53.296809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d791022d-bf0a-46c3-904a-79ba2721012c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:53.310839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:53.312007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:53.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:53.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:53.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:53.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:53.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 245/500] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:53.313541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519682e-64fe-4b95-9519-669d5607a33b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.313681 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519682e-64fe-4b95-9519-669d5607a33b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.313972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519682e-64fe-4b95-9519-669d5607a33b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.315224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 246/501] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:53.315926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519682e-64fe-4b95-9519-669d5607a33b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.335108 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.346657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.367054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 256/502] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:53.367913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.434236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519682e-64fe-4b95-9519-669d5607a33b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.467791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1b137-e725-4fa4-bbe7-3773b7853c68 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.469070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.469876 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.470164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.470443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.477338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.479146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:23:53.493435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:53.494560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 247/503] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:53.495687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.505493 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.506152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.506439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.506718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.545517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.575905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.578050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.586131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.598481 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c071c-abbb-4865-9c78-ba0344478b3a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.633096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.633764 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.634058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.634340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.635065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:53.635377 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.637342 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdac571-552e-4061-999a-8f3162f1e1ec None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.648726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 248/504] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:53.649920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.650212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.650493 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.665951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:53.667142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:53.678144 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 257/505] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:53.678985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.737517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 249/506] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:53.738279 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.754245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.777385 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a2c7-9428-47cf-b9bb-4fe1e86ca731 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.811283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.812089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.812380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.812710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.818450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.822884 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:53.831005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:53.832131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:53.833150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 258/507] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:53.834012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.844848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7c908-e94e-4116-9362-206e99ceab72 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.879815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.880533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.880830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.881124 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.881970 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:53.882283 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.883718 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.920709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 250/508] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:53.921670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:53.935268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e35a71-f2b1-4b6e-a5ec-ad8d7f22edaa None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:53.963019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:53.968769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:53.969622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:53.969949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:53.970228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:53.977662 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:53.979155 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:23:53.997145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:53.998323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:53.999647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.024960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91fe02-8fb9-4220-abf8-8dc7dcf469cf None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.058080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.059416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.059703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.059979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.063053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.070613 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.072154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:54.089855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:54.091119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:54.092421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.101330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410732e7-a959-476d-9385-de2dfe3266b1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.135832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.136721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.137013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.137299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.149023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.150498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:54.167955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:54.169690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:54.171095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.200420 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7491a27-6dbb-40d8-8901-3db0fc209a87 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.212065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.237115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.237854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.238147 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.238428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.239182 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:54.239496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.240929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.249698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:54.250473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.283938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff8ac-2ff7-4fce-a986-f82b8ec34cef None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.305380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.322193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233764a-f51c-4166-837c-c96162474151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.323347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233764a-f51c-4166-837c-c96162474151 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.323649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233764a-f51c-4166-837c-c96162474151 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.324249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233764a-f51c-4166-837c-c96162474151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.359417 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017fc26-b821-4e33-8f2e-93d418e61117 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.397120 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.397811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.398100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.398416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.399265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:54.399871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.401066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.402091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233764a-f51c-4166-837c-c96162474151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.403650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233764a-f51c-4166-837c-c96162474151 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.418624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 253/513] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:54.419466 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.452258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.515057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 261/514] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:54.515832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233764a-f51c-4166-837c-c96162474151 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.541387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c410cf-73dc-44c9-b04e-e934f8829f9d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.551376 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.576324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.577024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.577315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.577596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.578326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:54.578637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.580026 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.591715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 254/515] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:54.592325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.618049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233764a-f51c-4166-837c-c96162474151 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.652486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.653171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.653468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.653750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.654486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:54.654802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.656196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.668466 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 262/516] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:54.669261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.673587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.701974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995dbc9-39e7-4aa0-a97e-19d5e8ac4aac None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.735135 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.735927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.736213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.736526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.748598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.750057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:54.767108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:54.768321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:54.769691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:54.769691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:54.769691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.769691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:54.770016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f2351-4f71-4110-905c-b4ca6fb8a286 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.770448 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 255/517] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:54.770448 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.794322 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.803503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.809258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.809258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.809258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.872479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67e1b9-4046-4fee-a3b4-ba2bcabcbde9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:54.872688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.874142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.875950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:54.906838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:54.907724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:54.908020 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:54.908299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:54.918979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:54.920450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:54.937678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:54.938723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 256/518] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:54.939790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:54.979668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 263/519] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:54.981190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.014451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.045842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06fe80-5449-4392-a792-d0485ebd1535 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.079074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cde56-21ad-4864-ada9-062716f29430 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.079443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.080247 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.080572 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.080814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.080964 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.088180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.092245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:23:55.107340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:55.108560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 257/520] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:55.109629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.118952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.119632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.119924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.120205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.120975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.122437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.202732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 264/521] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:23:54 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:23:55.203549 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.220975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4eb06-68ec-4bfa-9d6a-f9d697da6baf None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.257121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.263878 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.264946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.265244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.265533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.267866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:55.267866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.268965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.284350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 258/522] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:55.285431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.325745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270265b-c80d-4eb5-9c7e-64f4ef8200b1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.366316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.366997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.367286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.367570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.368302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:55.368644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.370029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.384074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 265/523] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:55.384882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.406118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.414031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861be2a7-b030-4db1-a8cb-daf60cec0a6c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.459762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.460609 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.460905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.461193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.473659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.475530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.492547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fbd7e-1013-49bc-95da-1ca93367fce0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:55.493662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:55.494726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 259/524] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:55.495791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.535804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.536585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.536874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.537206 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.538002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:55.538319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.539774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.546667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.564073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 266/525] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:55.564073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.610717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a41-c908-4ca9-bcda-ce1018f4ed52 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.644418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.656711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.660629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.660629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.660629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.666272 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1dc3f4-d2c6-4fa2-8ac8-41d2fe8ac35c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.668906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.671277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:23:55.687194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:55.689146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 260/526] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:55.690303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.710219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.711039 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.711345 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.711626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.719744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.721571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:23:55.738073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:55.739162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:55.740248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 267/527] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:55.740883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.808538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c823dd1-e558-4198-a166-8dd1864fbc95 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.812662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:55.850391 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.851066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.851203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07d8f4-752e-4619-b871-4f8f075f0879 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:55.851615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.851615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.852338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:55.852695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.854090 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.866498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 261/528] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:55.867253 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.897109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:55.897777 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:55.898062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:55.898339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:55.899166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:55.899483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:55.900978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:55.906956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 268/529] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:55.907731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:55.910453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.001170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f919f99-1ac0-478a-8b6d-9b7f2c06eb7b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.034579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a3ba5-336a-4aba-bb32-4bbf3b1889ce None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.041787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.042484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.042816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.043100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.043956 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:56.044271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.046016 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.070899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 262/530] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:56.071946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.076694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.077387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.077683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.077968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.078775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:56.079098 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.080614 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.101105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 269/531] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:56.102170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.114097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.167624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.198747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2197d2c-530a-4acc-9745-fecb12bc92ba None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.213109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f54d5a-44c7-4d37-9a70-4c94e884b188 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.236164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.237022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.237396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.237592 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.245004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.246751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.251619 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.252501 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.252965 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.253416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:23:56.261361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:56.263402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:56.264706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:56.268881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 263/532] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:56.269752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.338710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.340912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.368695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.389235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce4cfa-8f2b-44ce-87c2-46e4755d234b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.409119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.424455 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.425210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.425626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.426011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.426960 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=ddf6bbbc36f74a3da54ee118b2dcfd23) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:56.427381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.428989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.435852 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 264/533] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/role_assignments?user.id=ddf6bbbc36f74a3da54ee118b2dcfd23&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:56.437458 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.461485 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 270/534] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:56.463432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.587772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a9e85b-4260-419f-a695-9069be88d703 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.626683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.627730 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.628268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.628797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.629821 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:56.630145 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.631598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.651671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 265/535] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:56.657454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.671495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:56.751353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b09b-7868-48db-a1ce-d44ef57d434f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.778768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a490d3-888a-488e-bdee-4de7ea63c961 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:56.827983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.828830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.829129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.829415 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.848194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:56.848921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:56.849208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:56.849491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:56.850333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=66f4f677a3fa4e1791d2525a6f0d3574) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:56.851422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.852954 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.853418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:56.854868 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:56.868842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 266/536] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/role_assignments?user.id=66f4f677a3fa4e1791d2525a6f0d3574&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:56.886170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:56.887423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:56.889441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:56.889441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:56.889441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:56.889441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:56.889441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 271/537] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:56.896733 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:56.992597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:57.042262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac004170-19d6-48a7-a7b8-aa3fcc7d3816 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.101310 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:57.102022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.102311 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.102594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.103352 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:57.103666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:57.107142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:57.125620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 267/538] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:57.131157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:57.163106 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:57.278758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23cf4c-cb25-4dba-bea2-a0a020d0a5a0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.331945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:57.333168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.333703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.334238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.347167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:57.348957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-e761c9f3-b937-4773-9420-c3ecb7c58a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:23:57.364281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:57.365514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:23:57.366589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:57.374156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 272/539] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:57.375779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:57.424220 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f9e2-58b3-478c-b526-9ad8f352f52a None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.424918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f9e2-58b3-478c-b526-9ad8f352f52a None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.425428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44f9e2-58b3-478c-b526-9ad8f352f52a None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.427023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 273/540] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:23:57.432233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.432819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.433343 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.458298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:57.459887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:57.533376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 274/541] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:57.570186 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cebe7e-86fd-4fe7-bc58-a7c199a9b853 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.574216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:57.592823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:57.634108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:57.651844 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:57.652766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.653057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.653349 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.654157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:57.654474 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:57.655940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:57.689974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef22997-4892-4966-bcfc-cb5ac5ae6d31 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.695262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 268/542] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:23:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:57.703982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:57.735315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:57.736806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.737364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.737883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.750824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:57.759974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:57.761211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:57.762253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:57.765997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 275/543] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:57.774390 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:57.900850 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:57.917751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f91fff-18a3-48f9-8f05-5e7f51452a33 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.975257 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480feed-fac9-4c2d-af67-1ae7d56cadf0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:57.994699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:57.995381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:57.995673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:57.995991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:57.996886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=d0d463df72ab4f539c4eb5670aadcee6) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:57.997213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:57.998677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:58.015920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 269/544] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:23:57 2022] GET /identity/v3/role_assignments?user.id=d0d463df72ab4f539c4eb5670aadcee6&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:58.034612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:58.035314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.035604 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.035887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.036685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:58.036999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:58.038486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:58.052856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 276/545] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:58.058510 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.188163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:58.257750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db934a7-46ba-466b-93f4-e4c6cdf75d47 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:58.313110 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:58.313943 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.315507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.315507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.326935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:58.328432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-47701e6b-43e3-4bd9-8df0-b5b470b7ac5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:58.346916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:58.349227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:58.351456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:58.351456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:58.351456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:58.351456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:58.351456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 270/546] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:58.357520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.369108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c5c2-1f4d-4b09-919e-cfdc5885a468 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.369700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c5c2-1f4d-4b09-919e-cfdc5885a468 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.370192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c5c2-1f4d-4b09-919e-cfdc5885a468 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.372051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 271/547] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:58.376949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.377466 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.377972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.402063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:58.405633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:58.530504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 272/548] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:23:58.551691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618630db-c8ac-4726-8500-addfb2585862 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:58.574617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.593036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:58.608180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:58.616227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:58.633526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:58.642830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 277/549] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:58.653390 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.759065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99165c-b0b3-43a0-b8f4-18da6648978a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:58.818769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad249e-b958-4cba-a99e-73d9779ad9d9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:58.857010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:58.857269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:58.857832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.857957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.858142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.858270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.858371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.858538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.866215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:58.867975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:58.881077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-5cdd71bd-3c25-4ffc-9ba7-99fb965db4a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:23:58.886351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:58.888290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:58.889533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 278/550] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:58.890289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:58.891276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:58.892269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:23:58.894541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8839-bb37-4a2c-93d7-9f8bd2fd815d None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:58.894541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8839-bb37-4a2c-93d7-9f8bd2fd815d None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:58.894541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb8839-bb37-4a2c-93d7-9f8bd2fd815d None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:58.894992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 273/551] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:23:58.895140 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 279/552] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:58.897921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.898103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8839-bb37-4a2c-93d7-9f8bd2fd815d None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:58.963727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.010397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.020534 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda8668-1a21-47c7-bddc-7679175d7637 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.034125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb8839-bb37-4a2c-93d7-9f8bd2fd815d None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.068234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.069235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.069473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.069759 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.070524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:59.070842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.072245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82688b7-cb36-4e32-979f-a4d0bad2cf7d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.081518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.082198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.082490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.082772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.083616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:59.083931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.085417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.096435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 274/553] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:23:59.096435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.096435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.096435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.119335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 280/554] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:23:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:59.119335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.128122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:59.129582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:59.207651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 275/555] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:59.208914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.249688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98699ad1-3d07-4bca-b932-b1cada7c000b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.252997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.287538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.288794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.289326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.289845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.301448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.303266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:59.327377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:59.328932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 281/556] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:59.330061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.341351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.358664 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e8917-3d03-4d0f-b56e-6517202bfa19 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.397361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.398027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.398318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.398605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.447976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dce92b-e42b-4bb5-b1b7-bbd662c6492b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.474953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.476222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18593c-13fb-4062-91c9-5226a46e0701 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.484882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.485776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.486142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.486808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.497920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:23:59.505681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:59.511936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 282/557] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:59.513456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.531451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.583570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.597074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 276/558] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:23:59.598652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59643-ed05-4cee-afa8-d3a2d7399151 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.599101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59643-ed05-4cee-afa8-d3a2d7399151 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.600271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59643-ed05-4cee-afa8-d3a2d7399151 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.605002 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 277/559] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:23:59.605002 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59643-ed05-4cee-afa8-d3a2d7399151 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.627803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498fa4d-7c03-4c1a-8fe3-39df7cc2c70f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.666056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.666732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.667023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.667308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.668716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:59.669041 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.670578 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.686688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 283/560] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:59.686688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.709961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59643-ed05-4cee-afa8-d3a2d7399151 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.748352 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.749184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.749477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.750019 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.750660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:23:59.750974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.752528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3fa236-71eb-4ce2-a56d-8123f019ccb3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.767031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 278/561] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:23:59.767031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.767031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.767031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.769993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.782814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:23:59.784102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:23:59.794232 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09dc61-33f6-499e-a985-4ece61ab3a8a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:23:59.831540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:23:59.832679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:23:59.833121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:23:59.833701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:23:59.834130 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:23:59.846906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:23:59.848630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:23:59.864428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 279/562] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:23:59.864428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:23:59.875398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:23:59.876745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 284/563] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:23:59.877927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:23:59.988469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b2aa5-e857-476e-a4e3-7089d9b5ca24 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.023613 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754c718-722b-41ef-91ec-9ad0b3971ddd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.025429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.026339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.026697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.027045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.035109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.036634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:00.051780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.052968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 280/564] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.054092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.056024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.065468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.069910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.069910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.069910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.078234 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.079723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:00.098408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.099531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.100636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:00.100636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:00.100636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.100636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:00.103106 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 285/565] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.103915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.111593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.176741 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b614bc-569e-4fe9-bd1c-811fbbe98bf8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.215289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9760-8dd4-4351-8366-b2ccbfe91d1e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.216291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.217005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.217299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.217680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.218421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:00.218745 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.220134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.237437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 281/566] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:00.237437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.256973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.257790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.258079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.258787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.270647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:00.278526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.279661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 286/567] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.281510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.324859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.339749 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.342467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef1e95-658f-4882-9dd4-5c672b39c96e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.375537 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.376144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.376459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.376745 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.377580 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:00.377892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.379379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.383081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef337ca7-8c71-40c5-967f-2a3c144467e0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.397627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 282/568] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:00.398455 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.416797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.417467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.417757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.418040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.418758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:00.419069 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.420479 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51025d-d4a7-4d85-aa97-3f2955d8da18 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.433013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 287/569] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:00.434796 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08791-8e02-406a-a38e-a0fb155f3c3c None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.435089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08791-8e02-406a-a38e-a0fb155f3c3c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.435372 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08791-8e02-406a-a38e-a0fb155f3c3c None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.440668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 288/570] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:00.440668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08791-8e02-406a-a38e-a0fb155f3c3c None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.500254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618945bb-bade-46f1-bf05-961e71eb66e9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.535121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.536610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.537423 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.537751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.538035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.538776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08791-8e02-406a-a38e-a0fb155f3c3c None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.545477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.547041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:00.561402 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.562655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 283/571] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.563738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.579595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.580273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.580594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.580875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.581628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:00.581941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.582617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.583326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.591228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 289/572] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:00.592010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.664989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496bb65-c13d-4724-b387-170915e0ab82 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.692560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb6c35-ccfa-475f-b4bc-7b6ba990f8cb None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.699215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.700008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.700291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.700598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.710744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.712246 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.725467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.726269 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.726561 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.726846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-73829926-3087-4058-8262-1e0d4b76565f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:00.729589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.731353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.732464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:00.732464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:00.732464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.732464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:00.732464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 284/573] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.732987 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.733276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.733552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.735023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.736518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.750400 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:00.751391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.752713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:00.754175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:00.754942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:00.756541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 290/574] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.757515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.781930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.813834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:00.818146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 285/575] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:00.819158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.858271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb21d-29f8-4df7-8790-93e47c62f8a7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.892622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.893296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.893582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.893865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.894652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:00.894973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.896435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.913012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 291/576] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:00.914329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:00.922504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f538b-c8b3-4ffa-b9b4-b92373111949 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:00.956756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:00.957562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:00.957884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:00.958164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:00.968974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:00.970434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:00.988666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:00.989739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 286/577] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:00.990789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.020060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.037947 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d270f-9263-4bd7-a21c-9ab1cafa78d0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.056387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.072444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.073074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.073371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.073656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.074386 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.074698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.076092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.087218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 292/578] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.088010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.108752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f3a11-5a4d-46b1-b36f-61ab343d88bc None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.142552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.143226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.143518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.143805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.144677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.144993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.146440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.163798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 287/579] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:24:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.164716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.194393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f217c71-eb9a-4086-ae49-686434f4cfde None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.228043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.228884 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.229178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.229463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.240136 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:01.247917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:01.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:01.250121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 293/580] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:01.250971 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.253300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.270347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bd15c-d922-4641-9cfd-c688742db294 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.281610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.304305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.305287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.305571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.306410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=c1ae03c079494246b8a14e85a6d6a60f) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.306731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.308172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.313565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 288/581] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/role_assignments?user.id=c1ae03c079494246b8a14e85a6d6a60f&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.314341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.367258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00189b-6c4d-4533-ba55-499ceede6eaa None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.409610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.410285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.410575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.410902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.411601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.412026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.413358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.431878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 294/582] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.432144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46670c4e-ca37-4bea-9421-2c937b79a28c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.432259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.469383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.470132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.470427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.470715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.478489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.480000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:01.495039 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:01.496346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 289/583] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:01.497460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.503532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.536719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.548901 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c88ade-815d-46bf-b349-a49427cbfc5d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.586407 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.587213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.587506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.587792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.599067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.600590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.605463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207d723-f177-4f5a-9f2d-d0c4110f6bc1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:01.618259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:01.619377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 295/584] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:01.625608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.649883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.650570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.650923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.651217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.652021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.652379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.653836 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.667403 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 290/585] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.668316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.728211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc5f3-35cb-4027-a87f-df15e849d89c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.743078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.766373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.767188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.767480 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.767755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] PATH_INFO: `/v3/users/glance` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.772759 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:01.775739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.777267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.778965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a31ba4-3eb2-4e8a-bd90-d7fe67ce62a4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:01.792393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:01.793609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 296/586] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:01.794781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.820301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.821244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.821719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.822172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.822973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.823292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.825531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.842206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 291/587] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.842206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.910380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac6b7-32cd-42d9-bfc5-39ca50056e73 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.947946 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.948654 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.948992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.949779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:01.950512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:01.950872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:01.951097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10207fee-66c4-427d-b246-bf02aac5de83 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:01.952259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:01.970728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 297/588] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:01.970728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:01.996605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:01.996605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:01.996605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:01.996605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.008259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.009846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.014342 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:02.029326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:02.030628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 292/589] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:02.031903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.046105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.103751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cf51b-ecb3-4dca-8b46-275fd9e2276f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.140418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cef53d-10bb-49a0-a400-bb42a07c7616 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.142865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04819431-4314-44b8-82af-742341d5afbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.143905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04819431-4314-44b8-82af-742341d5afbe None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.144048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04819431-4314-44b8-82af-742341d5afbe None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.144230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04819431-4314-44b8-82af-742341d5afbe None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.145065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04819431-4314-44b8-82af-742341d5afbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:02.145376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04819431-4314-44b8-82af-742341d5afbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.146813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04819431-4314-44b8-82af-742341d5afbe None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.170833 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 298/590] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:24:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:02.170833 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04819431-4314-44b8-82af-742341d5afbe None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.181467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.182376 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.182677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.182966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/1d851834591f4153ada12343e6808807` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.198670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=38c9321d65fa472fb58ed69d3fa5c42d, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.200262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.270444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.278963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04819431-4314-44b8-82af-742341d5afbe None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.295169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 293/591] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:02 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:02.296590 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.318279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.321009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.321009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.321009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.331249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.332893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:02.349982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:02.351331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 299/592] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:02.352667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.392603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.448282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea79c2a-1a84-4692-b25b-ad921ebc0b49 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.495517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c4324-8c66-48df-b48b-a749752e13d8 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.499285 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.500179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.500665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.501129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.502043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:02.502522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.504685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.522267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 294/593] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:02.523332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.539071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.539887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.540177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.540490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.553038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.554623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:02.573996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:02.575265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 300/594] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:02.576352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.580689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.656429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57067ae8-be6e-44b3-8f9e-056e4563912c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.681731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.701877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e378-4a96-449e-8b0e-49f446de4c2a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.704072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.705747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.706226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.706683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.707661 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:02.708152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.710248 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.726481 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 295/595] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:02.728501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.739440 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.740249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.740594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.741231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.749798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.751292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:02.767021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:02.768391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:24:02.770009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:02.772744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 301/596] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:02.773507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.844802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:02.864757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96f27f-d8d7-401a-800d-f5fbce69ade3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.885672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700abe8-37fe-46fb-bd49-3bffbe197d0a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:02.906990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.907944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.908433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.908996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.910046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:02.910533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.912156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.926079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 296/597] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:02.927251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:02.935778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:02.937027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:02.937563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:02.938073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/ddf6bbbc36f74a3da54ee118b2dcfd23/roles/1d851834591f4153ada12343e6808807` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:02.955887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=ddf6bbbc36f74a3da54ee118b2dcfd23, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:02.957986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:02.974430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.036184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33a183-ae32-4825-8d6e-1a364f4a997d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.053100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 302/598] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:02 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/ddf6bbbc36f74a3da54ee118b2dcfd23/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:03.054531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.125477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.126201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.126563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.126917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.127948 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:03.128354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.138711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.178973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 297/599] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:24:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:03.185361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.192781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f441c-1a9d-4973-8e7a-216c0a3ad1fd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.215028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.238069 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.239682 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.240179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.240911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.250559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.252417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:03.290738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:03.291863 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:03.293057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:03.296367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 303/600] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:03.301732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.389764 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.398487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648493f7-8810-4ad9-a4a8-4c4c690a2868 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.440357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a2136-5b74-459c-bdda-d7b13264c0ba None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.463967 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.465335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.465934 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.466442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.477260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.477991 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.478281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.478564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.479180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.479357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:03.479669 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.481192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796911-e8c1-49ad-a489-884eebaec8ff None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.481508 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.495758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 304/601] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:03.497765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfd81-063f-4bb2-85a3-5fb6fb526eaf None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.498065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfd81-063f-4bb2-85a3-5fb6fb526eaf None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.498348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bfd81-063f-4bb2-85a3-5fb6fb526eaf None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.499862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 305/602] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:03.502110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfd81-063f-4bb2-85a3-5fb6fb526eaf None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ebf8f687-ec21-4931-b599-6ca0e2229ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:03.506800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:03.507887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:03.509078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:03.509078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:03.509078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:03.509078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:03.511011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 298/603] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:03.513573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.514063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.514502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.533536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:03.534897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:03.547213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.618899 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bfd81-063f-4bb2-85a3-5fb6fb526eaf None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.624218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 299/604] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:03.625069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.661126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.662267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.662650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.663027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/66f4f677a3fa4e1791d2525a6f0d3574/roles/1d851834591f4153ada12343e6808807` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.679734 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=66f4f677a3fa4e1791d2525a6f0d3574, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.681498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.715688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.738176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b3565-27f1-475b-8ec7-f122379e0e38 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:03.780536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 306/605] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:03 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/66f4f677a3fa4e1791d2525a6f0d3574/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:03.782139 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.787860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:03.789250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:03.789802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:03.790307 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:03.794073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:03.794791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:03.801804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:03.831921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 300/606] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:03.837772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:03.967485 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:03.988476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8e90d-b57e-49e4-9f39-e5ff12dde502 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.007858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9e9eb-b8d2-422b-b0d9-03f49ffebb27 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.030662 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.031934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.032580 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.033093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.045767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.046587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.046912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.047156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.047882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:04.054508 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.055902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:04.056944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:04.058120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:04.059169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:04.062355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 307/607] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:04.063042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.069738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:04.078416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:04.079429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 301/608] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:04.080607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.187127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729681b-1776-474d-b583-e33c7ef71831 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.229993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.233026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.233569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.234060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.235040 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:04.235563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.237316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.247006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 308/609] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:04.257054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.274086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.306290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511563-4f33-4bb0-9faa-e8b88a7897fb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.367923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.369585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.369883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.371364 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.372170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:04.372513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.376238 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.402634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 302/610] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:04.406470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.429078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5149c91-86c8-4032-bb08-316a78bc0aa7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.483973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.484909 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.485264 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.485612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.507251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.507965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.508806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:04.540428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:04.541579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:04.542693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:04.542693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:04.542693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:04.542693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:04.544218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 309/611] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:04.545440 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.570757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451e7b-8927-4c10-a359-c44785d5ba3d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.607147 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.608194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.608624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.609001 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/d0d463df72ab4f539c4eb5670aadcee6/roles/1d851834591f4153ada12343e6808807` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.623072 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.625643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=d0d463df72ab4f539c4eb5670aadcee6, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.627205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d7af5-9c4a-4a45-960d-366fff1dc00a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.671735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208937da-4ce0-4d5d-b5f2-f29b6650be62 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.704027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 303/612] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:04 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/d0d463df72ab4f539c4eb5670aadcee6/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:04.706411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e86c9-a85a-4dda-8e73-68d4ef4f79f8 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.706981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e86c9-a85a-4dda-8e73-68d4ef4f79f8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.707533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e86c9-a85a-4dda-8e73-68d4ef4f79f8 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.709913 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 304/613] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:04.710132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.711018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.711411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.711797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.712744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:04.713170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.714892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:04.715762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.716225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.717111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.741738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 310/614] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:04.748508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.753747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:04.757350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:04.843988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 305/615] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:04.880764 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:04.911644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61a7c7-f5a4-4545-80a3-72047906d461 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:04.932487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.937785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:04.954073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:04.954985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:04.955349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:04.955705 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] PATH_INFO: `/v3/users/swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:04.977829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:04.979353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.002713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4d8d2-c10f-45c8-b4c9-cf08cdeb9689 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:05.007790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:05.008936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:05.010064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:05.029554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 311/616] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:05.037422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.038424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.039246 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.039533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.039815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.052218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:05.061873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:05.064215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:05.066459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:05.070242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 306/617] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:05.070242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.202828 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665aff1e-92e7-4b20-b10c-d4f087a6925f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.218331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:05.241095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.241787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.242080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.242395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.243121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:05.243439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.244860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.256013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 307/618] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:05.261789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.343522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0db8cf-3517-4b2f-959d-1bc0cb980376 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.373471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b08ae-0e47-4ecd-83be-06ae0b24c095 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.411303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.412119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.412435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.412737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.424141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.425806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:05.444905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:05.445979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:05.447052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:05.447052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:05.447052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:05.447052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:05.447052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 308/619] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:05.451888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.469717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.470422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.470566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:05.470776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.470988 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.471845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:05.472159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.473646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.511527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 312/620] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:05.514929 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.578182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:05.616178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cac941-7fb9-49c3-8530-e429012cb15c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.655758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.656378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.656703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.656992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.657731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:05.658046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.659443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12869a3a-9e56-4041-83ea-c3260cdb89e6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.667445 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a43bb4-830f-41b8-98de-76ad3dcdfce1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.672703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 309/621] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:05.674195 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5c93-ab0e-4892-bfbe-1c00ad27cd5b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.674499 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5c93-ab0e-4892-bfbe-1c00ad27cd5b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.674790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd5c93-ab0e-4892-bfbe-1c00ad27cd5b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.676083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 310/622] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:05.682181 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5c93-ab0e-4892-bfbe-1c00ad27cd5b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.710675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.712198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.712566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.712860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.727651 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.729562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-0b8244b9-b155-4ec5-a612-64ab01aa0270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:05.749100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:05.750284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:05.751393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:05.751393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:05.751393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:05.751393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:05.754974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 313/623] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:05.756268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.756598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.757132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.767788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:05.777846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:05.785717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:05.803169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd5c93-ab0e-4892-bfbe-1c00ad27cd5b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:05.841178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:05.842057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:05.842351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:05.842637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:05.851158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:05.852717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:05.864622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 314/624] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:05.865806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:05.871996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:05.873157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:05.874273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:05.882034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 311/625] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:05.888535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:05.900760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:05.996691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe3db7-39ac-437f-bcda-e4107a28101b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.003630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6537339-a3d4-477c-9999-a7afc7d1683a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.036583 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.041264 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.042307 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.042524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.043035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.043209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.043686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.043815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.044059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.044960 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:06.045113 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:06.053806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.053963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.054059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.054143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.062460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 315/626] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:06.063634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.076800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 312/627] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:06.076800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.166296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.188641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067bfee-30db-4a6f-9772-3d5ef3616258 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.206669 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743111c-f001-4745-a06c-4a4315825bcf None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.224468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.225578 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.226063 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.226536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.237330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:06.241762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.242561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.242871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.243154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:06.245110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:06.246755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 316/628] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:06.247857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.255870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.257380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-93e2658c-52b9-4be1-ad3c-676240cbf59e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:06.272367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:06.273463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:06.274515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 313/629] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:06.275086 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b24-dbfa-44fd-9d8c-87468db28e1e None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.275754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b24-dbfa-44fd-9d8c-87468db28e1e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.275754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d9b24-dbfa-44fd-9d8c-87468db28e1e None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.280442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 314/630] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:06.280442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9b24-dbfa-44fd-9d8c-87468db28e1e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.333088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.365690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcaa630-99ef-4aa1-bd00-db1b8facb27e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.390118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d9b24-dbfa-44fd-9d8c-87468db28e1e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.409202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.409864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.410151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.410430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.419283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.427291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.431363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.440254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 315/631] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:06.440988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.486743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.488514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007507cc-076d-464e-aa77-33b5a08f4dc6 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.551192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8412d9b-0c45-45db-b78a-5898fd6a422f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.564972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.588931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.589632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.589925 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.590209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.591054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:06.591468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.592945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.603621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 317/632] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:06.603621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.603621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.603621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.615297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 316/633] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:06.615297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.622757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:06.623970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:06.655851 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.696704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 318/634] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:06.697307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.735134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431b144-d031-4f35-a8fc-001ceadae68e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.772629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.773449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.773741 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.774077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.784508 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.785963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.804192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333520de-4d45-43ad-8763-faf3b401e899 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:06.804991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:06.806150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 317/635] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:06.807227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.837122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.845172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.854733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.854733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.854733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.861792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.863261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:06.881528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:06.882631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 319/636] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:06.884529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:06.913820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:06.922396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269a0c8-5a80-47b9-b082-1f8649d18571 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:06.958471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:06.959369 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:06.959656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:06.959931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/c1ae03c079494246b8a14e85a6d6a60f/roles/1d851834591f4153ada12343e6808807` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:06.976990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=c1ae03c079494246b8a14e85a6d6a60f, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:06.978453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:06.996085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6d82d-9cfa-4652-90c0-d0616d843ee3 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.030366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.031165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.031449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.031724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.042113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:07.050720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:07.051866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 320/637] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:07.052915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.063029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 318/638] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:06 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/c1ae03c079494246b8a14e85a6d6a60f/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:07.063795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.156795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.160685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.177799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fe381-2ac1-4ce3-8e33-11a2d258d4ba None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.186498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07a33a-5ff8-43ba-bbb4-dec7b974422f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.219521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.220207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.221128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.221128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.221861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:07.221861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.223247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.227990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.228713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.229008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.229296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.230041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:07.231565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.232747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde8d17-633e-4d1a-834f-84d23f3f3442 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.236987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 321/639] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:07.238077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.245456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 319/640] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:07.246921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab85e7-9a3d-49bd-908c-9c67f2bc0be9 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.247300 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab85e7-9a3d-49bd-908c-9c67f2bc0be9 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.247663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab85e7-9a3d-49bd-908c-9c67f2bc0be9 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.249281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 320/641] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:07.250065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab85e7-9a3d-49bd-908c-9c67f2bc0be9 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.350317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280ac5e-0f72-4ec7-90bb-8a5129a39432 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.363419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab85e7-9a3d-49bd-908c-9c67f2bc0be9 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.388047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.389038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.389338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.389624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.390361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:07.390794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.392297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.399077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.399942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.400229 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.400822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.401915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 322/642] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:07.403298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.405851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.406778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.413636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.416900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a1c8cb7d-d407-4035-b0dc-e6cae22c71d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:07.430641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:07.431981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 321/643] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:07.433263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.434079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.434079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.452708 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:07.457233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:07.515297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43f00-fbae-40e5-b48b-4929a658c585 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.530668 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:07.530668 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.562582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.563384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.563671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.563966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.570932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.572732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:07.587448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:07.588659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 323/645] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:07.590951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.644354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8508-c849-4541-b88a-94b617d7138a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.656583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.669549 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.680515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870098a-c627-488b-96cb-e00667313733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.681326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870098a-c627-488b-96cb-e00667313733 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.681618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870098a-c627-488b-96cb-e00667313733 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.681901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870098a-c627-488b-96cb-e00667313733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.692931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870098a-c627-488b-96cb-e00667313733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.694393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870098a-c627-488b-96cb-e00667313733 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.696524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a6c8a-4c40-48b9-bd0c-fe841e1b3b41 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-5870098a-c627-488b-96cb-e00667313733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:07.712847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:07.714123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 323/646] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:07.715607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870098a-c627-488b-96cb-e00667313733 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.741912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.742595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.742886 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.743169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.744011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:07.744329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.746335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.769818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 324/647] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:07.769818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.833196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870098a-c627-488b-96cb-e00667313733 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.868525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.869329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.869620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.869917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.872497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf878b0-c138-4d85-8018-4483d563dc25 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:07.881133 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:07.889744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:07.890968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 324/648] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:07.892025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:07.899560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.917489 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:07.918210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:07.918477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:07.918756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:07.919545 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:07.920003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:07.921505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:07.930586 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:07.936813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 325/649] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:07.937927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.005652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdcbed-34c3-433b-8846-38e10eec5593 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.043422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b14ed-f9c2-488b-8da1-950bcd190d5f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.048882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.049860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.050335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.050790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.051697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:08.052174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.053761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.067224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 325/650] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:08.068190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.084122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.084816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.085102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.085631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.141733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.161791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.163190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.170053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.177346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53208440-135a-405a-b6db-60b3d8328282 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.217905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.218582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.218872 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.219172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.219910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:08.220220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.221636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.235566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 326/651] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:08.236465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.272216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 326/652] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:08.273110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.342544 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661f246-9ad3-4ff0-98e3-5e2f420939b0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.354910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.376503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b93668-a9da-4aa0-ae72-e4685719ca4f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.381043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.381710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.382000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.382287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.383119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:08.383498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.385014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.391226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 327/653] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:08.392011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.421538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.428914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.429914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.430311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.430608 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] PATH_INFO: `/v3/users/glance` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.439124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.440667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:08.457302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:08.458906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 29 23:24:08.460344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:08.463287 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 327/654] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:08.464314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.521848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58f760-febd-435d-a006-97cbe8febb59 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.580629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.582515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.582515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.582515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.595433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.596941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.600018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695666a-50c1-446f-a661-7d2410e50a85 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:08.617719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:08.618863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 328/655] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:08.620838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.652937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.653771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.654045 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.654328 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.665983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.667275 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.669498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:08.689622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:08.690727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:08.691789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:08.691789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:08.691789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:08.691789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:08.692767 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 328/656] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:08.696495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.715938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.750731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ad8e-2c0a-4b37-ae30-79e744aaf8ed None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.798955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.800542 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.801175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.801771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.803197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:08.804163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.806396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.813395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c653f9-eace-4f47-af7c-e3013fb042a2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.833088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 329/657] 10.222.0.16 () {56 vars in 1137 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:08.834164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.861792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:08.863419 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:08.864047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:08.864657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:08.865866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:08.866791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:08.868703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:08.889173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 329/658] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:08.889173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:08.961099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de508a2d-e97e-42e5-a354-865e547a673a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:08.961740 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:08.995462 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.001411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.002428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.002651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.002994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.004131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:09.004658 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.006577 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.021750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 330/659] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:09.021750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.022216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe7be0-da1f-4fd4-bbef-3e3c38977d79 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.061939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.062903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.063359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.063864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.131881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6034e-0e22-4d15-bccd-a07c872c008c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.153876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.155375 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8e353-88eb-495f-bc15-6de19d5f9ca4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.170883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.171870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.172569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.172863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.181032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.182501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:09.197696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:09.199473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 331/660] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:09.200663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.216518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.259728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.272024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 330/661] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:09.273652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598fe7a-949c-4fea-883f-ed8f683d73c6 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.274148 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598fe7a-949c-4fea-883f-ed8f683d73c6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.274431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598fe7a-949c-4fea-883f-ed8f683d73c6 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.279771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 331/662] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:09.279771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598fe7a-949c-4fea-883f-ed8f683d73c6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.319351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd6cbd-e4a1-4016-a097-6a29ce91d597 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.356676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.357485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.357775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.358061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.365070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.366530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:09.381495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:09.382560 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 332/663] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:09.383616 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.390158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598fe7a-949c-4fea-883f-ed8f683d73c6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.426995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.427786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.428096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.428366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.429245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:09.429816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.431020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375decf6-73a1-4ed0-beb0-ac7f3c2823be None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.455134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 332/664] 10.222.0.16 () {56 vars in 1139 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:09.455134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.455134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.455134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.469823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:09.471014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:09.473914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.497097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5af34c-6567-4010-843c-2aefba007027 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.512076 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.533564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.534595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.535077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.535561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.547167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.548698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.548952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 333/665] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:09.550203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:09.567557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:09.568728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:09.569814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:09.569814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:09.569814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:09.569814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:09.573271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 333/666] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:09.574026 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.663267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a273b9-50c6-4299-92ad-d83a77d6414d None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.681355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5aeb8-9204-4f54-8a9f-2cba41f3858d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.701186 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.701858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.702151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.702435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.703220 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:09.703876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.705101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.715326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.718961 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 334/667] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:09.720001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.724517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.725187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.740571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.740571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.758250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.799089 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:09.800762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:09.834118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78112165-e50a-4869-bfb8-8b4de9c6052c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:09.868099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:09.868948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:09.869241 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:09.869524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:09.881152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:09.889798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:09.890982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:09.891992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 335/668] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:09.892869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.915262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 334/669] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:09.915262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:09.959876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:09.982744 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.003092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0e06-911c-4bd1-a053-3e1ac485a235 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.022930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fb55b-f186-4bd4-9d0a-73cd735ff689 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.040869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.041787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.042252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.042539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.043822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.044134 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.045558 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.062497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 336/670] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.062497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.064908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.065575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.065866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.066151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.066994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=ddf6bbbc36f74a3da54ee118b2dcfd23) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.067311 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.068779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.075408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 335/671] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:09 2022] GET /identity/v3/role_assignments?user.id=ddf6bbbc36f74a3da54ee118b2dcfd23&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.076194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.209369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd4c-4318-4dce-9786-6362649fb804 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.212436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea9154-40cb-4ce5-b22d-d805192bafb5 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.239001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.242641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.251270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.252101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.252389 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.252717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.256941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.258079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.258598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.259109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.260083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.260622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.266002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.266126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.267465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.275035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 337/672] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.276179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:10.293950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:10.295126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:10.296216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:10.296216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:10.296216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:10.296216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:10.296216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 336/673] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:10.296623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.405758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405f1cc-08ff-4a6a-b3d2-d2ed9b2a625f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.414244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a14abf-0aff-46dc-b435-12dfb6d225e8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.443937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.445469 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.445975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.446497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.449394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.450204 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.450496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.450999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.455718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.457597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.462037 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.463543 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:10.474449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:10.475524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:10.476650 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:10.479006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 338/674] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:10.480129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:10.486156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:10.487240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 337/675] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:10.488328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.529359 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.538016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.598531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499605-6992-4185-8af0-00b71db32877 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.603406 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68881bc4-3ec8-406e-bd32-5b43e07a188c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.640914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.641597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.641886 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.642167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.642902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.643077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.643289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.643728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.644020 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.644306 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.644621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.645139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.647093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.647611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc09cf-a598-432d-8fe8-c95b8e621983 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.656739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 339/676] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.664639 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 338/677] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.664813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.664916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a588-9d60-4b2d-b869-9773ccd719de None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.664916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a588-9d60-4b2d-b869-9773ccd719de None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.664916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506a588-9d60-4b2d-b869-9773ccd719de None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.664916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 339/678] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:10.664916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506a588-9d60-4b2d-b869-9773ccd719de None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.764083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.773523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506a588-9d60-4b2d-b869-9773ccd719de None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.779292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab9a19-7308-4d85-bb64-384e879d11fc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.781156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:10.809514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.810345 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.810638 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.810919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.816262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.817031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.817325 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.817609 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.817963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.818394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.818711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.819486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.820085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.837352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 340/679] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.837352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-afca2be2-5f09-445a-82aa-9d0a34a1ff12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:10.837618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:10.838640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 340/680] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.839765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.840524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.856770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:10.857975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:10.930414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 341/681] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:10.931354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:10.951799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a832b29-a67c-4ee1-b1bf-cf9c028c0769 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:10.986877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:10.987538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:10.987826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:10.988111 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:10.988977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=66f4f677a3fa4e1791d2525a6f0d3574) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:10.989292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:10.990826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:10.996702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 341/682] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/role_assignments?user.id=66f4f677a3fa4e1791d2525a6f0d3574&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:10.997481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.038426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.048511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.068727 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bebcf8-368a-46d2-8fb6-89aa1f07dc66 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.126197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.127460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.128670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.129197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.142178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.142938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5d471-bd22-4a75-aff6-aa5abe5f915b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.144320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:11.165706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:11.166906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:11.168080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:11.169792 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 342/683] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:11.173133 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.191602 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.191842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.192110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.192251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.193110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:11.193419 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.194876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.208868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 342/684] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:11.209722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.297003 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7d506-0be4-4fbe-93f3-110ecce9fb74 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.310520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.323591 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2688c-8ce1-4f8e-b569-5e6621451e74 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.349713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.351436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.352043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.352615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.363394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.364263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.364673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.365056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.366213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:11.366447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:11.366865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.368482 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:11.377309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:11.378501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:11.379553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:11.384589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 343/685] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:11.384589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.389170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.397105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 343/686] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:11.398044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.503206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f49ef5-f5fb-44d0-827a-cd3ee2fc1e02 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.513080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c712dff-18de-408b-a343-ece31e3c36be None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.539302 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.540688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.541171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.541643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.542999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=d0d463df72ab4f539c4eb5670aadcee6) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:11.543511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.545209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.549951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.550572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.550865 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.551151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.551915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:11.552233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.553665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 344/687] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/role_assignments?user.id=d0d463df72ab4f539c4eb5670aadcee6&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:11.553787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.554795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.577584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 344/688] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:11.582951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.600938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.629642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.674024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbbbb-6be1-459f-b251-a96f7829a572 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.748244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.749277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.749732 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.750177 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.794430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b523ad-5a98-4f7a-adb9-6def20f4d4ba None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:11.835061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:11.835875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:11.836166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:11.836490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:11.842159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.843825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.853231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:11.854729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:11.881435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:11.882779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:11.884194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:11.884194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:11.884194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:11.884194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:11.892768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 345/689] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:11.893738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:11.941158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.967799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:11.999617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 345/690] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:12.005788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.052242 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba3c4a-df16-4c1c-9056-b1f544c5d1e5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.104463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.106053 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.106447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.106831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.107670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:12.108089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.110152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.129514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 346/691] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:12.143824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.254371 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3d215-e847-48ef-9cd6-0429d36cb287 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.287680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69551-a101-47a4-9021-663e3cbf0a7e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.318213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.328862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.329671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.329965 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.330248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.331146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.332188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.332768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.333263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.338356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.343632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.345520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.346986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-28a3f2cd-6bd8-4102-934e-aabb28ebd876 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:12.359435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:12.360618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:12.361760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 347/692] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:12.362570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe83f-9317-46db-b0b0-549997194ad8 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.362669 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe83f-9317-46db-b0b0-549997194ad8 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:12.366823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:12.368775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:12.370922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:12.370922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:12.370922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:12.370922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:12.371413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe83f-9317-46db-b0b0-549997194ad8 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.371564 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 346/693] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:12.371708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 348/694] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:12.371845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.377349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe83f-9317-46db-b0b0-549997194ad8 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.404789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.489935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe83f-9317-46db-b0b0-549997194ad8 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.493550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3cca9f-94fc-41cc-b279-8c1f022bf302 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.526640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.527911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.529774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.529774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.529774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:12.529774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.530878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86835812-3be6-4e7f-9c1f-07447038a0bc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.533684 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.534551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.535040 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.535536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.536597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:12.537095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.538890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.547158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 349/695] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:12.548631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.548938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.549232 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.564426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 347/696] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:12.566038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.566680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:12.567910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:12.599560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.644782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 350/697] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:12.645636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.654873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.683525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd63f9-7c25-4fea-afd3-0f63abbbf250 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.722721 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.723523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.723813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.724103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.731854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.733412 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:12.747608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:12.748725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 348/698] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:12.750355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.786096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ebe79-3b8c-49a3-8b92-cfd29f3d315e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.830177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.831612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.832153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.832677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.857737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf96c9-68e3-4002-b9f1-f181d5a44aaa None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:12.878966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.900159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:12.900159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:12.900159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:12.900159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:12.900654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.900654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:12.903305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:12.915164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:12.916451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:12.917851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:12.920944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 349/699] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:12.922290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:12.925594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:12.928313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.044273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146642-a21a-4c3c-a27b-4a62294657d1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.060557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 351/700] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 29 23:24:13.061723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.089308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.090117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.090490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.090843 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.091739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:13.092122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.099326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.107103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 350/701] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:13.107974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.163623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.171237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.201247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081040c-8b00-4b38-a996-60b85bf9d094 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.215176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e73cd7-d712-4062-8fb6-30bb633f8425 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.238323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.239247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.239702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.240175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.241093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:13.241586 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.243227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.249016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 352/702] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:13.250038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.256418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.257235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.257588 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.257880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.271238 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.272699 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:13.295250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:13.296563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:13.297797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:13.297797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:13.297797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:13.297797 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:13.300538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 351/703] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:13.301544 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.369210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04543306-4891-4c72-94a2-02ebaf0e1ae5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.405713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.411337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.412513 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.420332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.420332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.420332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=c1ae03c079494246b8a14e85a6d6a60f) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:13.420332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.420332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.421355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ff303-b564-4052-9d24-521d6f959d94 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.428439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 353/704] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/role_assignments?user.id=c1ae03c079494246b8a14e85a6d6a60f&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:13.428439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.437662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.461187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.461879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.462175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.462464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.463200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:13.463520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.465018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cbf802-5bc0-4708-bf6f-20b92225afaa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.471644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 352/705] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:13.473073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d817cf-9412-4666-9fcc-3d6d1dbc40d3 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.473375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d817cf-9412-4666-9fcc-3d6d1dbc40d3 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.473665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d817cf-9412-4666-9fcc-3d6d1dbc40d3 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.479469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 353/706] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:13.481507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.481809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.482099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.517686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:13.518940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:13.614893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f735d1b-c593-4956-a3c6-de094156d996 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.615487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 354/707] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:13.667310 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.677885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.678937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.679230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.679513 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.680252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:13.680665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.682061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.695566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 354/708] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:13.701139 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.768749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.786241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89699fd8-d7c5-42d9-8a7e-9fb42a15baae None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.804781 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:13.825780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3550a9-16aa-487e-985f-c7fbc171cd43 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:13.827520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.828518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.828816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.829104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.842413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.844177 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.866086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:13.866892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:13.872066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:13.872066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:13.872287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:13.873355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:13.874468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:13.874468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:13.874468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:13.874468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:13.874468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 355/709] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:13.879116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:13.880622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:13.883187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:13.899683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:13.900872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:13.902488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 355/710] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:13.907675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.011839 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770c2f8-e75f-4fee-9677-09a05d67ba68 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.036789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80d9e3-93f2-40ca-a434-d85a3246333e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.051896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.052642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.052937 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.053390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.054247 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:14.054570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.056178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a010194-5c30-400f-8961-8f6e57c1856c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.057657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:14.070629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 356/711] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:14.072212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618cf5-e6c2-4287-83dd-0a1f9c01e31f None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.072837 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618cf5-e6c2-4287-83dd-0a1f9c01e31f None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.073305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be618cf5-e6c2-4287-83dd-0a1f9c01e31f None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.075807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 357/712] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:14.081228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.081526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.081935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.083540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.084316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.084638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.084923 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.085716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:14.086033 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.087510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.101219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:14.102462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 356/713] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:14.103076 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:14.103322 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.130143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:14.198162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 358/714] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 29 23:24:14.199578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.245128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e462-65a8-44ac-b9a4-208716355975 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.282635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.283668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.284196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.284772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.285710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.287388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.307527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279712a-86a6-4a75-871c-31e47a91a317 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.345196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.345871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.346167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.346454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.347331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:14.347659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.349154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.355168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 359/715] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:14 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:14.360605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.379008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:14.442961 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 357/716] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:24:14 2022] POST /identity/v3/users => generated 254 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:14.494217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cde6c-976d-40ae-8a2b-925054b2c511 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.538673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.539420 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.539732 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.539998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] PATH_INFO: `/v3/services/network` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.540725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.542256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:14.556813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:14.558622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:14.559649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 360/717] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:14 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:14.564641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.630130 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:14.725752 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770db178-a19e-48bd-8297-bdbae9582281 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.767879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.768598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.768886 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.769169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.769885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] RBAC: Adding query filter params (name=network) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:14.770195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.771584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e1b84-59c5-48d4-a49d-6692920f738d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.776680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 358/718] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:14.785521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:14.875145 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:14.899338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb29ea26-e34c-4d32-b1db-c6c93aa04029 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:14.939647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:14.940336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:14.940655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:14.940942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:14.941672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] RBAC: Adding query filter params (type=network) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:14.941985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:14.943638 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc09bc-b67d-4cd8-918a-efadf3a72500 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:14.949173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 361/719] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:15.856767 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ef51-c330-4eff-9e5d-57b9739b4e88 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:15.857311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ef51-c330-4eff-9e5d-57b9739b4e88 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:15.857311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1ef51-c330-4eff-9e5d-57b9739b4e88 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:15.858976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 359/720] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:15.864435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b24d-30fc-45f8-a3ca-bbbacf2551fc None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:15.865243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b24d-30fc-45f8-a3ca-bbbacf2551fc None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:15.865789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8b24d-30fc-45f8-a3ca-bbbacf2551fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:15.887830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-59b8b24d-30fc-45f8-a3ca-bbbacf2551fc None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:15.889635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-59b8b24d-30fc-45f8-a3ca-bbbacf2551fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:15.975485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 362/721] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:16.017571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1ef51-c330-4eff-9e5d-57b9739b4e88 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:16.162159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:16.172748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1ef51-c330-4eff-9e5d-57b9739b4e88 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:16.218731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:16.219422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.219715 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.220005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.220825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:16.222227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b637b3-bc61-4317-a7b5-31b6d412ebac None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:16.329969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 360/722] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:16 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:16.390598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31075-9397-46f9-b150-42ca8722d82b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.390984 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31075-9397-46f9-b150-42ca8722d82b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.391188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e31075-9397-46f9-b150-42ca8722d82b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.393219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 363/723] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:16.398792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.399093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.399384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.422374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:16.423527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:16.530488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 361/724] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:16.558007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e31075-9397-46f9-b150-42ca8722d82b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:16.676756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:16.738100 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e31075-9397-46f9-b150-42ca8722d82b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:16.806536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:16.807357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.807652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.807938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.829258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2485a4b8-4361-4b29-be83-343f39db56cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:16.837191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:16.838288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:16.839281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 364/725] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:16.844268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:16.939749 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467bf10-298b-41a1-b896-e8b5a9cc8375 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.940394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467bf10-298b-41a1-b896-e8b5a9cc8375 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.940394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467bf10-298b-41a1-b896-e8b5a9cc8375 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.942258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 365/726] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:16.947707 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534019fa-5b67-44f3-bca5-2c02ed3e3711 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:16.948005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534019fa-5b67-44f3-bca5-2c02ed3e3711 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:16.949330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534019fa-5b67-44f3-bca5-2c02ed3e3711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:16.979972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-534019fa-5b67-44f3-bca5-2c02ed3e3711 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:16.981256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-534019fa-5b67-44f3-bca5-2c02ed3e3711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:16.987500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.008622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee37c9-0fd6-4801-8c63-55666c1559ef None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.138359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.139302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.139593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.139875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.140783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:17.141104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.142540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d046b-d188-49e0-910d-66b73f0c6db7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.152645 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 362/727] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:17.153967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054864c8-f8e3-4f6c-b336-555dab62ecdb None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.154260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054864c8-f8e3-4f6c-b336-555dab62ecdb None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.154541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054864c8-f8e3-4f6c-b336-555dab62ecdb None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.159935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 363/728] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:17.160834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054864c8-f8e3-4f6c-b336-555dab62ecdb None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.178129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 366/729] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 29 23:24:17.181189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.181490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.181777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.213300 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:17.215146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:17.288920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054864c8-f8e3-4f6c-b336-555dab62ecdb None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.293712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.309196 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 367/730] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:17.310056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.351227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.352036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.352322 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.352624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.365218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.366371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.369446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:17.386882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:17.388024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:17.389481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:17.389481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:17.389481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:17.389481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:17.389481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 364/731] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:17.394367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.456129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d0b13-18f6-4013-a590-2b7b8bc734c4 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.498357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.499155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.499513 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.499722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.508216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1c8fa-09f6-43a7-996a-237dab20c093 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.511943 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:17.520065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:17.521422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 368/732] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:17.522597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.555425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.556243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.556571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.556857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.568077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:17.576427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:17.577787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 365/733] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:17.578974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.589563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.644493 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.646932 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaf60e-02b8-469d-b29d-c7b8584c4865 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.683148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.683826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.684120 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.684424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.685170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:17.685487 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.686879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f5a1a-5fca-45c2-b3b4-3ebbd4569e34 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.693279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd6d47-eb58-42cf-93b0-85505ed188be None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.707079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 369/734] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:17.707079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef958b-2314-4e81-af7f-dc8132a2a3ed None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.707079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef958b-2314-4e81-af7f-dc8132a2a3ed None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.707079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef958b-2314-4e81-af7f-dc8132a2a3ed None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.707528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 370/735] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:17.708117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef958b-2314-4e81-af7f-dc8132a2a3ed None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.732625 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.733305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.733598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.733876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.734631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:17.734946 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.736330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.748930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 366/736] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:17.748930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.829812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef958b-2314-4e81-af7f-dc8132a2a3ed None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.842419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.847179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb649d-03e0-4b6e-b137-e45814caa830 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:17.863564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:17.867723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.870424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.870424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.870424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.870424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:17.870424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.871416 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f67e-566a-4c0d-9717-aecca6154900 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.883756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 371/737] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:17.883756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.883756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.883756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.885805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:17.887128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:17.887427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:17.887697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] PATH_INFO: `/v3/users/swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:17.896859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:17.902672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:17.902807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:17.902807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:17.913038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:17.914208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 367/738] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:17.915949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:17.979072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 372/739] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 29 23:24:17.980717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.033452 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5cf85-d5c3-4ad0-8fb9-97a2639f41df None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.069590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.070552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.070839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.071120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.083281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc225ef-fa11-426c-bab9-7bdcc9d6768b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.085376 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.124508 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.125442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.125734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.126018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.138926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.140449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:18.159986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:18.161184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:18.162264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:18.162264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:18.162264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:18.162264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:18.164758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 373/740] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:18.165999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.199637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.201142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:18.218889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:18.219992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 368/741] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:18.221107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.253828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.291865 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba5ccc-da71-42c9-9487-4caa7d322d3b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.328145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ce8d-46d6-49eb-a063-74988c3691b1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.332655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.333340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.333628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.333910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.334746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:18.335064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.336944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.363139 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.363837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.364123 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.364451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.365179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.366606 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.440456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 369/742] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:18 2022] POST /identity/v3/services => generated 240 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:18.440456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.471873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 374/743] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:18.478573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.497574 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.564916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.576239 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb86c3-4cac-44f5-b3bf-9fa7a7454cae None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.595816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26830b-a3a7-4be6-bdb9-b2baf35e1aa2 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.617381 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.619114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.619114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.619114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.619931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:18.619931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.621939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.635629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.636394 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.636725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.637253 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.638825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:18.639142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.640496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 370/744] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:18.640627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.641732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.652905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 375/745] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:18.653755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.742390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.758067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b0226-91f8-4c19-8f00-08c114511f7e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.773343 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88922973-a1f9-455d-984c-be5c7637df8d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.793716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.794379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.794667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.794955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.810222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.810780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.811047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.811335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.811614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.819497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.820995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:18.836680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:18.837862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:18.839018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:18.842411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 376/746] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:18.843471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.871673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:18.873329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106df1e3-98a7-45d5-b08c-667746306b12 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:18.951723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6383f96-afb5-4f57-b0bb-3aabc59191ce None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 371/747] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc152f8-2c2f-40c5-b89e-81593dcdb556 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc152f8-2c2f-40c5-b89e-81593dcdb556 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc152f8-2c2f-40c5-b89e-81593dcdb556 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 372/748] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:18.983012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc152f8-2c2f-40c5-b89e-81593dcdb556 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:18.991467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:18.996751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:18.997555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:18.997846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:18.998133 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.005570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.007028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:19.023291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.024490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 377/749] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.026239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.050006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.110143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc152f8-2c2f-40c5-b89e-81593dcdb556 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.138096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddf84e-4018-4670-b731-0aa01b2b79d0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.146070 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.146750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.147036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.147315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.148160 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:19.148503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.149949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaede0-a13a-423f-a521-c1c645a5be64 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.170121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 373/750] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:19.171459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.171753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.172034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.179848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.180864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.181157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.181439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.189061 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:19.190309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:19.192558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.194007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:19.212309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.213443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.215057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:19.215057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:19.215057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.215057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.218793 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 378/751] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.219454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.263809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 374/752] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:19.265058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.270671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.309052 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.329240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcb548-83ef-4ef5-9177-4c02f33eba93 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.366533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.367138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.367426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.367707 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.368630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:19.368947 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.370382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.382073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac2390-5e36-4969-89fd-0f833eae64e9 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.387999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 379/753] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:19.389181 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.421490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.422142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.422425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.422700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.493989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.494886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52b247-38c8-4e4b-ad13-019110557425 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.496169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.496517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.530393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69d880-5767-49a6-802f-84145753918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.531361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69d880-5767-49a6-802f-84145753918f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.531648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69d880-5767-49a6-802f-84145753918f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.531931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69d880-5767-49a6-802f-84145753918f None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.532694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69d880-5767-49a6-802f-84145753918f None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:19.533007 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69d880-5767-49a6-802f-84145753918f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.534383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69d880-5767-49a6-802f-84145753918f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.537552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.550540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 380/754] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:19.550540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69d880-5767-49a6-802f-84145753918f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.622902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 375/755] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:24:19.622902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.662938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69d880-5767-49a6-802f-84145753918f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.700658 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.701824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.702296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.702730 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.703648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.705308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.718152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.719451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.720522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.721543 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.732944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282134c-0aad-4039-9ade-345a5d069e0e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.753467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.768701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.769553 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.769896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.770177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.772619 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:19.781369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.782986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:19.800062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.805920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 376/757] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.806992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.837521 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb926410-c627-4683-9a1d-4daa365746ab None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.873241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.873995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.874854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.874854 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.881280 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.882716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:19.897194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.898243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 382/758] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.899356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:19.912030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b124a-305b-4bcf-8891-418d8ca38888 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:19.946900 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:19.949610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:19.949610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:19.949610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:19.959563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:19.961120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:19.977984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:19.983499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 377/759] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:19.984880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.025516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.040079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045093d-7ebc-4d4b-bf2f-88bbac782b79 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.047397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.076281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.076994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.077282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.077563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.078282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.078597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.079983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.089659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.089659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.118090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f56c0-5da7-4357-86c4-d9e52af37750 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.155559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.156156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.156476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.156768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.157498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.157816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.159209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.176095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.176095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.201593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a15b5-f37a-42ba-9f61-f32cf190e216 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.238404 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.239079 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.239368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.239652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.240490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.240809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.242257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.259259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.259259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.272142 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.278688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.282729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a88b3-3e17-43e4-8515-16fbbe4abaff None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.317897 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.318572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.318860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.319140 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.319866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.320178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.321594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.336447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 379/763] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.336447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.368368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f357a-c460-4cb1-9077-d30b018376fa None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.406460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.407065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.407362 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.407650 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.408384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.408742 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.410121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.415272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 385/764] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.416074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.443626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5abab1-9e27-483d-aadf-1581cd62040e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.483422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.484834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.485143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.485426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.494700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.496204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.497013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:20.511849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:20.515559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 380/765] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:20.516680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.527459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597008f-c29c-4ded-93dc-f0f5588dfddc None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.539853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.564629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.565288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.565575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.565956 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.566783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=c1ae03c079494246b8a14e85a6d6a60f) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.567099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.568686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.584696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 386/766] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/role_assignments?user.id=c1ae03c079494246b8a14e85a6d6a60f&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.584696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.643025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00be82-b60e-49ea-9bf6-97cbeb4078ac None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.682373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.682889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.683202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.683484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.690765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.692293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.699411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0579672-194f-4d74-8196-00e78b18ef6f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:20.706896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:20.708196 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:20.709538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:20.713077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 381/767] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:20.713995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.739920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.740646 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.740941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.741225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.742038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] RBAC: Adding query filter params (interface=public, service_id=151d340cdfdd46edb50da367f7059737, region_id=RegionOne) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.742360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.743747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d00b3-5720-4875-99e5-17a4c233f074 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.760731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 387/768] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/endpoints?service_id=151d340cdfdd46edb50da367f7059737&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.763358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b83fb-8552-4433-aec2-b3eabbb5c9c1 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.764500 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b83fb-8552-4433-aec2-b3eabbb5c9c1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.764755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b83fb-8552-4433-aec2-b3eabbb5c9c1 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.767647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 388/769] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:20.767647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b83fb-8552-4433-aec2-b3eabbb5c9c1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.772804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.805604 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:20.828566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c77970-6ac8-443e-aac9-8c660727fae0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.865892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.866581 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.866872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.867157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.867960 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.868284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.869778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.887287 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 382/770] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.887287 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:20.889392 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b83fb-8552-4433-aec2-b3eabbb5c9c1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:20.927130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:20.928045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.928189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.928366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.929167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:20.929479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:20.930920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b5820-20a9-4e65-87a6-05f7b57b8b27 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:20.948573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 389/771] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:20.948573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:20.948573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:20.948573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:20.965225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:20.966495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:20.997409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112843fe-a210-4c2c-acd9-5ecaf96ae26d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.026257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.034533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.035198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.035488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.035764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.036477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.039414 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.039562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 390/772] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:21.044337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 383/773] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:20 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:21.045055 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.045164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.116824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.168087 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90775-b393-40de-bc4a-89232e53f590 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.189536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95229ed3-76db-496f-bd0f-e0ac37e837fd None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.207730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.208273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.208585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.208864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.209719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=07f8b149fa72440bba91008f9b5bfd5a) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:21.210033 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.211825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.218194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 384/774] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/role_assignments?user.id=07f8b149fa72440bba91008f9b5bfd5a&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:21.219019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.243861 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.246383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.246941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.247815 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.251459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=38c9321d65fa472fb58ed69d3fa5c42d, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.254125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.301702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.329930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 391/775] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:21 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:21.347800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a2611-7a54-4203-8834-e3d69666a961 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.391299 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.392176 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.392535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.392823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] PATH_INFO: `/v3/services/network` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.393501 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.394998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:21.410317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:21.411611 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:21.412692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 385/776] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:21.418073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.502810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.557126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f1e8-e358-4ed4-8dae-bd98400ba503 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.594156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.594843 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.595130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.595411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.596133 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] RBAC: Adding query filter params (name=network) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:21.596479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.597875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.603111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 392/777] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:21.609291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.717779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbdee9-29e6-4f53-a24b-711c84b1b1ee None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.749060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.755476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.756075 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.756359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.756671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.757393 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] RBAC: Adding query filter params (type=network) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:21.757799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.759252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.766565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 386/778] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:21.772295 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:21.882226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2330-6781-4187-8f7c-73fb283c8542 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:21.900784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:21.920044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:21.920743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:21.921031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:21.921318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:21.922111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] RBAC: Adding query filter params (interface=public, service_id=eebeb433746046d9b0e800582750f8cf, region_id=RegionOne) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:21.922462 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:21.923842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de0a1e-856a-4b32-bd54-9bd308486b12 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:21.929589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 393/779] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/endpoints?service_id=eebeb433746046d9b0e800582750f8cf&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:21.937643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:22.074855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93f09d-d865-4b2e-89db-d48600acb68f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:22.130455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:22.131141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:22.131428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:22.131711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:22.132413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:22.133884 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1169f6-eb66-45f4-bdc4-a270b27d798f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:22.141337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 387/780] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:21 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:22.769173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385f2f-72bd-4132-8394-cc45019421a2 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:22.769896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385f2f-72bd-4132-8394-cc45019421a2 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:22.769896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98385f2f-72bd-4132-8394-cc45019421a2 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:22.771101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 394/781] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:22.776629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:22.777170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:22.777365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:22.796187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:22.797410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:22.875354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:22.892380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 388/782] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:22.927944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385f2f-72bd-4132-8394-cc45019421a2 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.076222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98385f2f-72bd-4132-8394-cc45019421a2 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:23.110880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:23.111691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.111978 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.112256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.123442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:23.131318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:23.133679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:23.135827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 395/783] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:23.143631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.295724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae72850-a757-44f5-b829-4dd0647b7ed0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:23.339283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:23.339890 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.340178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.340490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.341245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:23.341557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:23.342938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:23.356636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 389/784] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:23.362216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.438292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:23.512791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26061781-ed41-4ee3-a7ca-2b0c818bd409 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:23.566043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:23.566864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.567156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.567443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.580654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:23.582103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e4fdb8d6-3441-45f1-9078-0ab859b81968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:23.603914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:23.606776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:23.609261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:23.609261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:23.609261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:23.609261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:23.609261 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 396/785] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:23.615597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.660334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79befc-0d68-43ad-ae62-4eb055387d67 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.660334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79befc-0d68-43ad-ae62-4eb055387d67 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.660334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79befc-0d68-43ad-ae62-4eb055387d67 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.661048 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 397/786] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:23.667296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.668446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.668927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.695193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:23.697591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:23.698823 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:23.785787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38952b-b24f-4842-ac03-e5eac256d485 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:23.829104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 398/787] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:23.850893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:23.852032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:23.852622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:23.853171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:23.854193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:23.854724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:23.856492 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:23.870538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 390/788] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:23.875672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.880785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:23.904155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:23.987692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e09e3-3ea1-4213-983c-0057f113ab47 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.000029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.002770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca3f57-fcd3-4d78-96fe-347e3c8ae0c1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.026021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.027691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.028171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.028680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.037822 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.039553 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.048522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.049436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.049802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.050165 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-3bf103ab-18f3-44ed-9051-6a676a8a7f06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:24.057684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.058825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:24.059968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:24.061972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:24.062976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 391/789] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.064522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971462-cbbd-46c3-b616-3bc9e4816ca2 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.065006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971462-cbbd-46c3-b616-3bc9e4816ca2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.065463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00971462-cbbd-46c3-b616-3bc9e4816ca2 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.070985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 392/790] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:24.071969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00971462-cbbd-46c3-b616-3bc9e4816ca2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d21206d7-f177-45da-ad4d-001fc341a77e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:24.077336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.078473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:24.079490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:24.083806 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 399/791] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.085302 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.086374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.086830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.113423 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:24.115013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:24.190067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 400/792] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:24.191273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.209035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.218535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00971462-cbbd-46c3-b616-3bc9e4816ca2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.264256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.265228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.266079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.266383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.267513 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:24.267834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.270336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def942c9-37a6-45b6-87b6-d98d67d6bdf9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.289295 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 393/793] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:24.290589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a770d3-c868-4fe3-9b00-be519f623741 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.290885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a770d3-c868-4fe3-9b00-be519f623741 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.291166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a770d3-c868-4fe3-9b00-be519f623741 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.296519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 394/794] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:24.296519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a770d3-c868-4fe3-9b00-be519f623741 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.309218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970f24-b54a-466e-9c73-96d6ef861051 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.329078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.343587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.344264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.344592 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.344873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.345745 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:24.346056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.347430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.357257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 401/795] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:24.362635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.412727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a770d3-c868-4fe3-9b00-be519f623741 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.443188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.449345 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.450203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.453862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.453862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.453862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.453862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d0f5cd14-5107-4bd4-aba8-7b1aa628d0c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.465905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.467015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:24.468043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 395/796] 10.222.0.16 () {56 vars in 1129 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.469096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.469096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.469096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.474240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cfa7f-53d9-418c-af5b-7d914f7613cb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.486933 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:24.488113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:24.510335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.511677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.511972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.512258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.523627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.525213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:24.543017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.544156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 402/797] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.545312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.563226 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 396/798] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:24.563993 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.589997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.663690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13cdfd1-688a-4a5e-a989-b101fac722ad None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.670469 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57934747-385f-4dbd-a216-5fd3487122d6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.690693 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.700421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.701323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.701621 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.701963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.707463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.708136 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.708468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.708736 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.709443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:24.709751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.711268 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.715063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.716554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.722725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 397/799] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:24.722725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:24.739492 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.740603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.741728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:24.741728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:24.741728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:24.741728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:24.745467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 403/800] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.746332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.811671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.826745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962217c-1ce1-451a-a396-9391e5dd2329 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.850201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d5ad-25d3-4d92-8018-a12c286e600a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:24.861098 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.861772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.862058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.862337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.863055 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:24.863361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:24.864762 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:24.876643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 398/801] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:24.877431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.885083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:24.886967 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:24.887278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:24.887567 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:24.898097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:24.905864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:24.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 404/802] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:24.907983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:24.959448 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:24.983799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc78b1-4fb2-458d-946b-76a180fc9360 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.011897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f92d9-408d-4719-a9bc-9b95c28d89e9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.018296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.018967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.019262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.019543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.020247 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:25.020589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.021980 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd2583-ef50-49e1-affa-f723f18ec1f3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.033670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 399/803] 10.222.0.16 () {56 vars in 1124 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:25.033670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a7d7-85bd-408d-a362-9cbe7ccf0576 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.033670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a7d7-85bd-408d-a362-9cbe7ccf0576 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.033670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a7d7-85bd-408d-a362-9cbe7ccf0576 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.034519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 400/804] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:25.035693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a7d7-85bd-408d-a362-9cbe7ccf0576 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.049470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.053787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.054460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.054747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.055024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.055774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:25.056085 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.057495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.069216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 405/805] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:25.070000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.141783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a7d7-85bd-408d-a362-9cbe7ccf0576 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.171977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.174421 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.175222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.175446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398d9aa-374d-4d77-ab57-dd1654c8bdbf None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.175569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.175778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.183732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.185229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:25.199593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:25.200969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 401/806] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:25.202146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.214067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.214676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.214966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.215243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.215993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:25.216301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.217692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88abe-7cac-485f-b535-53c8afdbd397 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.226080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 406/807] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:25.227330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.227625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.227909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.244807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:25.246528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:25.271703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.302171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd02bbe-7a77-4398-95c5-5719a4778460 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.314785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 407/808] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:25.315626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.339361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c947-6947-4165-8714-990743ca081e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.340102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c947-6947-4165-8714-990743ca081e None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.340387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c947-6947-4165-8714-990743ca081e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.340696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440c947-6947-4165-8714-990743ca081e None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.341441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440c947-6947-4165-8714-990743ca081e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.342826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440c947-6947-4165-8714-990743ca081e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.405551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.414769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39095a-1fc1-43d7-b87e-7c5de2376639 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.425512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 402/809] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:25.429244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c947-6947-4165-8714-990743ca081e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.469495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.470778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.471408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.471883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.482359 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.484277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:25.502467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:25.503944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:25.505338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:25.507512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 408/810] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:25.508610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.541675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440c947-6947-4165-8714-990743ca081e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.570500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.579906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.580665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.580952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.581233 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.582326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:25.582639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.584084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.596502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 403/811] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:25.598401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.634246 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7198bd-f690-4556-b911-d2917c444ad1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.673140 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.673957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.674248 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.674536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.685459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.687254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.694767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:25.706102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:25.707336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:25.714986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:25.714986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:25.714986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:25.714986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:25.715317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c37c-7ea4-4d34-9d1e-0e1b5f3035f7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.715410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 409/812] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:25.715410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.748472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.749210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.749499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.749772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] PATH_INFO: `/v3/services/network` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.750435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.751812 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:25.764305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:25.765573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:25.766590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 404/813] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:25.767557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.819784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.828319 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582c619-eab2-4859-884d-f0d4ad382caa None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.864361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.865064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.865353 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.865641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.866486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:25.866802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.868248 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.874470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b93b44-6fcc-46e3-9af4-c36ed9025b91 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.891158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 410/814] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:25.891158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:25.915919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:25.917163 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:25.918069 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:25.918360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/c1ae03c079494246b8a14e85a6d6a60f/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:25.920391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=c1ae03c079494246b8a14e85a6d6a60f, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:25.921892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:25.949130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:25.994083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219685-0b3b-4ca1-bd13-a0dba8ca41cb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:25.997377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 405/815] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:25 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/c1ae03c079494246b8a14e85a6d6a60f/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:25.998429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.034475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.035080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.035375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.035660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.036422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:26.036814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.038181 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.052170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 411/816] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:26.057466 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.155652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a468c-7f56-41f6-a9e6-a00830282951 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.169703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.191984 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11366b-a50d-4c4b-8e28-fe6a298594a0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.206664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.207406 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.207702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.207979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.208785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] RBAC: Adding query filter params (name=network) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:26.209051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.210431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.213855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.216074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 406/817] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:26.218821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.234474 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.235293 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.235585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.235869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.247926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.249457 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:26.271907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:26.273072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:26.274146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:26.274146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:26.274146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:26.274146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:26.281536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 412/818] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:26.282746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.327342 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ece2-974c-4c57-a9c8-5dd65f14ecaa None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.364882 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.365487 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.365780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.366065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.374876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.376523 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:26.392714 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:26.393918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 407/819] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:26.395066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.397556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb42df-0f9f-4003-b72a-72a688930ccf None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.434833 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.437101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.438061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.438554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.439028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.439962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] RBAC: Adding query filter params (type=network) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:26.440538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.442183 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.452630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 413/820] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:26.453805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.488909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.508177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f115ec-8a10-4057-9837-35cbdded96b4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.546323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.547150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.547461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.547768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.548493 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:26.548809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.550279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.568813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 408/821] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:26.570063 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.579642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994681-10e7-43c9-9ee5-7103811c491f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.627290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.627987 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.628277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.628647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.629511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:26.629866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.631321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.660298 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 414/822] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:26.661536 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.681612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.689953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16094b-1670-4fd3-8e57-43bac73022f5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.733671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.734754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.735284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.735797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.736918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.738592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.772148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:26.781711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ac983-da25-40b9-b8c6-caa663c5eed9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:26.813154 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 409/823] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:26.814200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:26.859446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:26.860208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:26.860527 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:26.860810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:26.873727 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:26.875228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:26.904252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:26.905491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:26.906555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 415/824] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:26.913432 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.022306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f31c6-b0e8-4bbd-895e-fe62033aec29 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.066423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.068175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.069056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.069572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.076890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc4921-2459-4fc5-a597-4ce350643ed1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.097407 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.126768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.127691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.127817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.128102 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.128948 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:27.129270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.130737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.147069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 416/825] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:27.153615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.163553 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.166676 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.169746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.290038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b102b74-5dd6-4cd7-8578-4492ca8018c4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.304974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 410/826] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:26 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:24:27.316437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.344107 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.345397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.346151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.346514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/07f8b149fa72440bba91008f9b5bfd5a/roles/1d851834591f4153ada12343e6808807` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.365697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.367577 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=07f8b149fa72440bba91008f9b5bfd5a, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.369811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.418830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41143aba-663e-4213-ab19-7897a46f0eb5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.453570 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.454379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.454668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.454948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.456063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 417/827] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:27 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/07f8b149fa72440bba91008f9b5bfd5a/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:27.472157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.473710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a3999a09-f49e-46a0-a616-d3e57f92cb05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:27.493959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:27.495103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:27.497594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:27.497594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:27.497594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:27.497594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:27.497594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 411/828] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:27.501602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.560081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e390-865c-4675-856d-7699087bf264 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.560808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e390-865c-4675-856d-7699087bf264 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.561305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4e390-865c-4675-856d-7699087bf264 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.563265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 412/829] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:27.573410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.574164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.574679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.575846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.594284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:27.595903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:27.623562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc99-059c-471d-86cf-b370d8e867c5 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.662804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.663483 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.663793 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.664081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.664818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:27.665134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.666509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.679687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 413/830] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:27.679856 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 418/831] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:27.686212 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.703690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.719462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.811426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e8412-e5b0-4a72-87c6-cc7e52469f4b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.847464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef381e67-9d83-44be-8f3e-c4a7dd169425 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:27.862176 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.863812 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.864597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.865116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.865612 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:27.876547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.880359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.885273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:27.886712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:27.887180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:27.887621 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:27.888485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:27.890368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:27.896534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:27.897769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:27.898989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:27.905018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 414/832] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:27.906258 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:27.907484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:27.908701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:27.909768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:27.912795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 419/833] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:27.919210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.014850 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:28.024577 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a482c5-676d-45e0-ab3c-78b910397ce4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.050595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6d0c1-29ea-4bbc-bfc3-3b1984719ed8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.072708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.074475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.074774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.075057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.075861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:28.076177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.078244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.091107 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.092169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.092724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.093269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.094202 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:28.094728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.096331 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.102422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 420/834] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:28.107994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.109454 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 415/835] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:28.115319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.170171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:28.225158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8026f-b6a1-45a1-9c71-0c4208aa298e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.244522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b89500-ba5b-421f-8504-2b32057725cd None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.263053 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.263721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.264278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.264592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.265480 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:28.265744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.267192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cddde-469e-4a7e-b85e-3083162cc9e3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.273710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 416/836] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:28.278606 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6daf-93a0-4a5d-8bf8-42d1585abfaa None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.278896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6daf-93a0-4a5d-8bf8-42d1585abfaa None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.279182 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f6daf-93a0-4a5d-8bf8-42d1585abfaa None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.284731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 417/837] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:28.286394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.286691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.286979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.292933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.293641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.293933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.294226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.294969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:28.295286 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.296779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.309059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 421/838] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:28.310831 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:28.312515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:28.326940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:28.399616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 418/839] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:28.424998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.537393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989ef15-b186-4b49-863a-a6e45a50ecde None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.547644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:28.572510 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.573352 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.582538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.582538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.584803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:28.592692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:28.593811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:28.594851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 422/840] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:28.602151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.714957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93776f2e-9668-4bda-bc67-3b948f364a43 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.754102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.755171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.755681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.756178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.757234 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:28.757864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.759481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.769279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 419/841] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:28.775272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.884676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a41d0-26e6-445d-92e6-d607b1be8a93 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:28.923369 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:28.925005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:28.925539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:28.926057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:28.937191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:28.938904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:28.958050 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:28.959144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:28.960223 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:28.960223 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:28.960223 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:28.960223 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:28.968584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:28.969753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 423/842] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:29.002123 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.085830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79282d-0359-4900-88a4-382fd68935f4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:29.122560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:29.123280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.123573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.123860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.124637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:29.125019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:29.126483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:29.139589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 420/843] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:29.145288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:29.170999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.254933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c89140-c232-4304-8f27-b860a04bf189 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:29.292157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:29.293033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.293328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.293615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.301096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:29.302554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:29.317370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:29.318454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:29.319598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 424/844] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:29.325096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:29.396984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.431072 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119a18-3039-4103-8eae-58ac158651b5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:29.467410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:29.468114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.468430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.468725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.469582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:29.469912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:29.471497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e5207-2d99-459b-8698-15361f71536d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:29.491048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 421/845] 10.222.0.16 () {56 vars in 1135 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:29.497654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:29.591225 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.601438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82066c8-aa4b-4e90-901d-86d410e26856 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.602206 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82066c8-aa4b-4e90-901d-86d410e26856 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.602767 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82066c8-aa4b-4e90-901d-86d410e26856 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.605477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 422/846] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:29.611021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.612605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.612605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.615108 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43215e-eab8-4533-8dab-ef65050c9d50 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:29.629735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:29.631082 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:29.662739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:29.663822 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.664393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.664965 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.708425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 423/847] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:29.725909 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:29.746610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:29.748769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:29.786293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.833809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8788d-9e9f-4bb3-9835-01330b6cf14b None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:29.856146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:29.880986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 425/848] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:24:29.884070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:29.886705 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:29.887566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:29.887861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:29.888145 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:29.901439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:29.909696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:29.910849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:29.911869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 424/849] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:29.916830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.010135 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789f073-1e1b-4665-a6c8-20b034c9e47e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.046051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4128-d02d-4fc6-9705-4a5862e769e5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.048583 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.049399 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.049682 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.049977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.062262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.063847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.068615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:30.083683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:30.092465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:30.093573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:30.093573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:30.093573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:30.093573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:30.093573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 426/850] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:30.096622 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.100220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.101217 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.101518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.101809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.102592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:30.103278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.104314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.120253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 425/851] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:30.122349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.139984 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.222940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8cf93-938e-4774-a38f-3624d1817310 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.242168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197fa0e-ecd6-4614-9d10-055d44ab0e7c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.270798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.271972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.272810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.273615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.274652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:30.275218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.277586 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.277953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.278759 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.279049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.279332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.290249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.291711 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.293576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 427/852] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:30.299272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:30.320000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:30.321161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:30.322298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:30.322298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:30.322298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:30.322298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:30.330160 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 426/853] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:30.330716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.376869 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.402773 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.412340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9716d3-954f-4f56-838c-cbda18385ac7 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.444537 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d327b9-1e2f-4d7c-9552-ae95071a0284 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.448603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.449427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.449721 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.450003 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.457251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.458750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d26ea0e0-5df3-45ef-b1cc-afd72120c134 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:30.473845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:30.475058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:30.476132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 428/854] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:30.476776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b909-bbda-4bf4-8eb8-5f34f7bad0b1 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.476776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b909-bbda-4bf4-8eb8-5f34f7bad0b1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.477254 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617b909-bbda-4bf4-8eb8-5f34f7bad0b1 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.478443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 429/855] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:30.481608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285f2b-5818-48fe-a4a2-fb203878444c None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.481966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285f2b-5818-48fe-a4a2-fb203878444c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.482195 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285f2b-5818-48fe-a4a2-fb203878444c None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.483456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 430/856] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:30.483688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.484154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285f2b-5818-48fe-a4a2-fb203878444c None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.484354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.484633 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.484819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.485614 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:30.485930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.487581 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8f4cc-f152-4d37-bc23-7c037e24baf8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.499641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 427/857] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:30.500933 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3bb6-7118-4e20-ba35-9c5e9418c398 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.501211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3bb6-7118-4e20-ba35-9c5e9418c398 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.501498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea3bb6-7118-4e20-ba35-9c5e9418c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.518301 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-8fea3bb6-7118-4e20-ba35-9c5e9418c398 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:30.519502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-8fea3bb6-7118-4e20-ba35-9c5e9418c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:30.586467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 428/858] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:30.587382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285f2b-5818-48fe-a4a2-fb203878444c None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.587722 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.588019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.588304 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.605180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:30.606332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:30.620803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.627912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.628606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.628894 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.631929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.631929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:30.631929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.631929 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.644538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 431/859] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:30.645324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.660345 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.676329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 429/860] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:30.677197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.766991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea4eb6-2fc9-4d2e-996a-e32af2f4b4f7 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.775330 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae277-57c2-4210-8cb6-14395b42c7df None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.800350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.801205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.801493 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.801776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.809326 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.810104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.810227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.810432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.810721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.811377 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.811546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.812781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:30.825539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:30.826658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:30.827659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:30.829170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:30.830370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:30.831867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:30.832758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 430/861] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:30.832758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.832975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 432/862] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:30.833552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:30.847461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.901834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:30.930310 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292d10e-2e5f-48b0-8619-27e6c2d65510 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.930605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92883fc9-d06a-42c6-807d-76814426045e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:30.965319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.965979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.966099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:30.966275 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.966557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.966700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:30.966976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:30.967266 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:30.967376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=c1ae03c079494246b8a14e85a6d6a60f) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:30.967691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.967998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:30.969210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.969427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:30.975035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 431/863] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/role_assignments?user.id=c1ae03c079494246b8a14e85a6d6a60f&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:30.975820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.059712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:31.073127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 433/864] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:30 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:31.075184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.102229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81462fe6-97f4-451d-9abd-28078f7d4336 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:31.155087 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:31.155797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:31.156090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:31.156378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:31.157239 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:31.157509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:31.158953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:31.168450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 432/865] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:31.172208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.237072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd6e76-ea0e-4aa6-8992-e3409b58fd59 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:31.274382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:31.279413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:31.280109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:31.280427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:31.280713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:31.281575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:31.281890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:31.283345 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:31.303659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 434/866] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:31.309811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.320189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0413c3-716c-4125-a9d2-b889cef77e89 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:31.362928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:31.363786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:31.364186 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:31.364597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:31.365386 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:31.365709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:31.367270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:31.384453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 433/867] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:31.441840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe4676-cd1f-4a14-92f9-9cd72712500a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:31.482717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:31.483400 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:31.483700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:31.483988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:31.550017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:31.561692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:31.563106 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:31.668993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 435/868] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:31 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:24:31.677537 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.680709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:31.787623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481bcbf7-86b2-4f48-a0cd-94aa7cec04d5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:31.824037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:31.825156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:31.825602 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:31.826046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:31.837453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:31.839637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:31.858107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:31.859366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:31.862248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:31.862248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:31.862248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:31.862248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:31.862248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 434/869] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:31.868435 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:31.959467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:31.969994 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc07d0-8110-432f-8908-e0a0a278fa3f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:32.005478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:32.006154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:32.006445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:32.006730 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:32.007454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:32.007766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:32.009166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:32.021776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 436/870] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:32.028001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:32.086588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:32.133647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628aeb36-4912-4a81-8f92-d076153c2290 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:32.171783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:32.172641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:32.172930 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:32.173213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:32.181052 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:32.182540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:32.197465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:32.199409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:32.201778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 435/871] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:32.208904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:32.316028 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9aa296-813b-4d42-8633-3a2001789b3f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:32.352606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:32.353213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:32.353505 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:32.353789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:32.354606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:32.354973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:32.356465 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d113d-36c7-4d84-92b4-7cf034059466 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:32.370877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 437/872] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:32.376847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:32.481168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1312a1-347e-49b2-8388-65cd9cf144f4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:32.496195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:32.521449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:32.522120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:32.522413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:32.522694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:32.523529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=07f8b149fa72440bba91008f9b5bfd5a) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:32.523846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:32.525328 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b3b2-7970-4fa2-9613-2ffbe2c75d7d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:32.531970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 436/873] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:32 2022] GET /identity/v3/role_assignments?user.id=07f8b149fa72440bba91008f9b5bfd5a&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:33.131063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7745-a043-431a-8d75-344776cc39c1 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.131344 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7745-a043-431a-8d75-344776cc39c1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.131630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7745-a043-431a-8d75-344776cc39c1 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.133170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 438/874] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:33.138696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b1ba-9883-42b6-ac64-66b283bf091c None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.139845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b1ba-9883-42b6-ac64-66b283bf091c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.140357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6b1ba-9883-42b6-ac64-66b283bf091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.158306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-d8a6b1ba-9883-42b6-ac64-66b283bf091c None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:33.159855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-d8a6b1ba-9883-42b6-ac64-66b283bf091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:33.232374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 437/875] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:33.255697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d7745-a043-431a-8d75-344776cc39c1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.269345 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:33.329105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0cb0-ab83-422e-b00b-7ac0c5794166 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.329417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0cb0-ab83-422e-b00b-7ac0c5794166 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.329682 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0cb0-ab83-422e-b00b-7ac0c5794166 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.331401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 438/876] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:33.336286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.336605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.336897 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.357266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:33.358391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:33.374889 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d7745-a043-431a-8d75-344776cc39c1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.418777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.419966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.420256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.420838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.421505 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.423340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:33.438715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:33.440030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:33.441208 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 439/878] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:33.448004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.448515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 439/878] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:33.469431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.545946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:33.577015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdbf-d459-4159-9e3d-ff39b8e0edfb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.582779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:33.597547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da9e34-9510-4dce-9cae-2c35bd393d6c None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.616268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.617226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.617687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.618139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.618855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:33.619172 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.620597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b188c-18c0-4a25-b0f7-56e5afe98c84 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:33.632470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 440/879] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:33.632470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3df7-3e4e-499e-9d14-2ffbf97f4896 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.632470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3df7-3e4e-499e-9d14-2ffbf97f4896 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.632470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e3df7-3e4e-499e-9d14-2ffbf97f4896 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.632470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 441/880] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:33.634129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3df7-3e4e-499e-9d14-2ffbf97f4896 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.638422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.639498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.639781 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.640059 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.640817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.642237 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9f6d855f-2c19-4cee-a318-3adaac2727f5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:33.654640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:33.655924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:33.657051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 440/881] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:33.658012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.658012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.658012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.675680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:33.676899 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:33.749615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e3df7-3e4e-499e-9d14-2ffbf97f4896 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.756679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 441/882] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:33.757731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.791063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.791757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.792053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.792938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.793670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:33.793827 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:33.793991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.795374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:33.800335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 442/883] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:33.804953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.811770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:33.877480 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595090ec-7ee8-4af3-8e86-a3200e53f0f2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.920122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.920986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.921126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.921412 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.922149 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:33.922465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.923970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:33.929826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 442/884] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:33.937512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:33.951004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f93e9-a6b9-4f2a-bad0-47f24163c261 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:33.993318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:33.994543 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:33.995012 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:33.995697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:33.996631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:33.998187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:34.050509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:34.056953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73e64-7fcd-4bb2-8174-ad122b0b5234 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:34.094125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:34.094828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:34.095170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:34.095500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:34.096241 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:34.096561 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:34.098010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:34.106392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 443/885] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:34.112450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:34.115694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 443/886] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:33 2022] POST /identity/v3/services => generated 269 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:34.232116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c28908-0f6e-45ca-b92a-aa967d845559 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:34.279310 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:34.279994 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:34.280279 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:34.280588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:34.281391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] RBAC: Adding query filter params (interface=public, service_id=53b4b1db11814f5991426e50edfbff0f, region_id=RegionOne) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:34.281709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:34.283099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e443e28-0de7-40c9-881c-5e4fff3e6750 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:34.292029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 444/887] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:34 2022] GET /identity/v3/endpoints?service_id=53b4b1db11814f5991426e50edfbff0f&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:34.297859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:34.369059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:34.408520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888ebd1-80e9-472d-8571-ecf2b868c040 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:34.444631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:34.445315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:34.445600 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:34.445880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:34.446571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:34.448004 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847f5f9-5ba3-461e-9ac7-6fd51b942756 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:34.454985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 444/888] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:34 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:24:34.741535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c80b-25a7-4b0b-897e-78643d710de2 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:34.741858 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c80b-25a7-4b0b-897e-78643d710de2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:34.742109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c80b-25a7-4b0b-897e-78643d710de2 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:34.743728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 445/889] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:34.749494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:34.749793 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:34.750081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:34.768048 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:34.769378 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:34.841173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 445/890] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:34.864372 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c80b-25a7-4b0b-897e-78643d710de2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:34.889478 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:34.979826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c80b-25a7-4b0b-897e-78643d710de2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.017004 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.017808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.018092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.018368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.029390 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:35.037653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:35.038773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:35.039791 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 446/891] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:24:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:35.045337 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.110957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:35.157674 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bfe7f-8059-4902-bc0f-67132b7fbac2 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.193489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.194155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.194443 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.194725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.195476 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:35.195787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:35.197193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:35.205775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 446/892] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:35.211607 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.299198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:35.319050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751695f2-f436-465f-ba01-32a90d6ceb4c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.354091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.355427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.355713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.355991 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.366775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:35.368286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:35.388503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:35.391076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:35.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:35.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:35.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:35.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:35.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 447/893] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:35.397747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.503780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8914b3-4275-42cb-9bfe-ec3b08b5336a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.522101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:35.539641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.540316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.540635 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.540916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.541640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:35.541950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:35.543892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:35.556719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 447/894] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:35.562271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.666814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b8a90-dbe5-4c83-adae-50c501943b8b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.696116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:35.701238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.702060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.702345 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.702621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.710195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:35.711951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:35.728459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:35.729643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:35.731939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 448/895] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:35.736333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.843877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088d861-d97b-45f0-a251-cc3497503415 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:35.879489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:35.880176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.880789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.881073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.881918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:35.882231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:35.883662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac8ce0-d2f4-4c11-a994-6ad0916e37ff None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:35.903109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 448/896] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:35.908846 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:35.978239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809b79-3f5e-4bf7-9ce3-d1082dbdef62 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.978936 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809b79-3f5e-4bf7-9ce3-d1082dbdef62 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.979759 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33809b79-3f5e-4bf7-9ce3-d1082dbdef62 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:35.982716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 449/897] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:35.987622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:35.995496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:35.995496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.006293 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:36.007896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:36.023083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10de4c4-caea-457c-bdb7-6cb10e9dc8f8 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.041199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.065910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.066792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.067092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.067671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.088374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 450/898] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:36.112702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.148783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.159399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.161717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.234596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830428bf-eed7-4aeb-a108-72be4378cdf5 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.282888 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 449/899] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:24:36.283122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.283122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.283122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.283122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.283506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.284748 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c9124-425b-4c31-89be-4b9fb1fe394e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.285211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.368118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 451/900] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:36 2022] POST /identity/v3/services => generated 241 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:36.398456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.406340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe549-4079-4640-a56a-193f2ad3b1e5 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.406890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe549-4079-4640-a56a-193f2ad3b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.406890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe549-4079-4640-a56a-193f2ad3b1e5 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.412628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 452/901] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:36.412821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71962d5-b4a5-4d5b-86c8-b9f119257648 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.417175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3880-604c-42fa-a0e4-c91b5b476ee5 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.417175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3880-604c-42fa-a0e4-c91b5b476ee5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.417175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3880-604c-42fa-a0e4-c91b5b476ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.441907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-653a3880-604c-42fa-a0e4-c91b5b476ee5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:36.443861 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-653a3880-604c-42fa-a0e4-c91b5b476ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:36.457384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.458235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.458527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.458800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.470367 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.471874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.474456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:36.491319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:36.492585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:36.494197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:36.494197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:36.494197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:36.494197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:36.498158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 450/902] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:36.501474 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.537721 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 453/903] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:36.560034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf9d7-4a83-438b-b227-a92a822eabdc None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.560333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf9d7-4a83-438b-b227-a92a822eabdc None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.560663 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf9d7-4a83-438b-b227-a92a822eabdc None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.562063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 454/904] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:36.562771 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf9d7-4a83-438b-b227-a92a822eabdc None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.625525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e526-8dac-4e62-9db4-f4d9a15833e1 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.659770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.660463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.660756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.661034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.661755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:36.662062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.663437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157da81-3f93-47a1-b0a8-dcff1c123f63 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.672157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.675809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 451/905] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:36.677046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.677344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.677627 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.684119 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf9d7-4a83-438b-b227-a92a822eabdc None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.696219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:36.697508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:36.724072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.724935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.725227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.725511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.726168 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.727549 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:36.741115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:36.742408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:36.743688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:36.746773 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 455/906] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:36.747786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.771428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.777599 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 452/907] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:36.778738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.863758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8bc71-5061-494e-bb15-66d9f7df4ce8 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.890689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db1ccb-3bac-4614-b64b-0e2ffb901770 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:36.903485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.904559 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.905129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.905573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.912996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.914737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.921601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:36.927148 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:36.927826 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:36.928117 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:36.928413 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:36.929144 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:36.929470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:36.930854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:36.931647 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:36.943689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 456/908] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:36.944838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:36.945555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 453/909] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:36.945555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.028231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.050303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59a750-4fae-4b0c-b4f4-f40450f4f96a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.052160 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0054cdb3-4585-4963-ae0f-3deff637a635 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.085992 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.086763 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.087056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.087340 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.088138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.088488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.090468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.092263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.101780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.102250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.102541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.103221 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.104469 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 454/910] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.105305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.110507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:37.117589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:37.118772 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 29 23:24:37.119777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:37.123795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 457/911] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:37.124708 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.172276 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.217702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eacb2-ca2e-4201-be64-8467be345bab None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.236614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e9f942-88bd-4fa5-8253-514ac8703f10 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.251311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.251990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.252280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.252595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.253311 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.253623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.255083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.259874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 455/912] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.264647 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.277759 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.278596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.279071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.279356 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.280190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] RBAC: Adding query filter params (role.id=2974424f26b645508b4fba20505a7dc9, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=07f8b149fa72440bba91008f9b5bfd5a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.280537 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.282085 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.292541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 458/913] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/role_assignments?user.id=07f8b149fa72440bba91008f9b5bfd5a&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=2974424f26b645508b4fba20505a7dc9 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.292541 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.312591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.401036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817510b-ace1-4333-bd69-e2e59f0264fc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.419151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ba03e-7213-4c08-8cbd-9eb3c63f3943 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.426093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.449273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.450504 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.450974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.451324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.452113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.452448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.454035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.460906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 456/914] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.467442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.467442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.467442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.467809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.468363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] RBAC: Adding query filter params (interface=public, service_id=7c5ae7dd0ace4e7b8b2a129bb48d8dc9, region_id=RegionOne) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.468712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.469429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.470089 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.476033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 459/915] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/endpoints?service_id=7c5ae7dd0ace4e7b8b2a129bb48d8dc9&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.484166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.577190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.604350 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db91df-4a25-41b0-b446-cb3b08909f97 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.614512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d11d52-af90-4de0-bf3d-0f8a62d17f5f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.642383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.643470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.643975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.644550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.645505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:37.646081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.647759 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.658070 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 457/916] 10.222.0.16 () {56 vars in 1114 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:37.659358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:37.660228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.660949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.661239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.661522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.662220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.663611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552f45c-4a1f-4462-8adf-e603fae14be8 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.670809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 460/917] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:37 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:24:37.720674 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:37.783356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014a0f-23c5-4916-9411-68797ba03be8 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:37.821277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:37.822724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:37.823253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:37.824320 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:37.825424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:37.827143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c443a-5a60-4ba5-afd8-7ff570340193 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:37.897318 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 458/918] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:38.525048 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c776-9b48-4b2c-a9b9-512013c5ec0d None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:38.525602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c776-9b48-4b2c-a9b9-512013c5ec0d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:38.525602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c776-9b48-4b2c-a9b9-512013c5ec0d None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:38.527710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 461/919] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:38.533303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:38.533721 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:38.533910 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:38.551744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:38.552955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:38.630667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 459/920] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:38.654361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c776-9b48-4b2c-a9b9-512013c5ec0d None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:38.763656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c776-9b48-4b2c-a9b9-512013c5ec0d None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:38.800996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:38.802049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:38.802524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:38.802972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:38.803800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:38.805370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:38.808329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:38.818595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:38.819998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:38.821267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:38.824525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 462/921] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:38.833880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:38.860508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:38.942686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc3dbb-223a-43cb-94eb-2aa4ff2b79e1 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:38.980102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:38.980818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:38.981131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:38.981385 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:38.982104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:38.982416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:38.983807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:38.989204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 460/922] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:38.994814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.109348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb772-17a0-4eac-9386-17c6ad6d5d34 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:39.145498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:39.146176 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.146467 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.146751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.147531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:39.147847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:39.149264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:39.154687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 463/923] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:39.160445 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.258427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:39.268180 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be151-6e97-468d-9256-f79567fcb36f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:39.304708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:39.305672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.306150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.306605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.307559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] RBAC: Adding query filter params (interface=public, service_id=50ad1ad0fcd94c059cbd48c7a04a9183, region_id=RegionOne) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:39.308582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:39.310135 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2be5b-fb95-4315-8051-c2f44ae3d9a2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:39.315939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 461/924] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:39 2022] GET /identity/v3/endpoints?service_id=50ad1ad0fcd94c059cbd48c7a04a9183&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:39.321430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.388901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:39.434070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba9d59-48d1-4a20-8d8b-d7326f281f35 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:39.439698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9148e-435c-4992-9c02-bae7a5c15694 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.440006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9148e-435c-4992-9c02-bae7a5c15694 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.440272 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9148e-435c-4992-9c02-bae7a5c15694 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.441945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 462/925] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:39.447066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.447308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.447663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.467755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:39.469526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:39.474345 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:39.475305 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.475816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.476321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.477252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:39.478855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:39.485779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 464/926] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:39 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:24:39.555838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 463/927] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:39.579882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.692565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e809b7-5b19-49c3-9331-c4174e87b05e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:39.719670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:39.728595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:39.729512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.730381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.730667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.742014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-dbafa995-7ab7-4556-a721-296aadf8ef15 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:39.751052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:39.752175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:39.753226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 465/928] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:24:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:39.758753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.849566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:39.866185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c01151-1766-41a7-bd45-f8017e656ab6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:39.902866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:39.903555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.903843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.904124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.904916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:39.905232 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:39.906626 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:39.910784 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67df5e-f360-46f5-847f-0ba092eb9993 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.911077 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67df5e-f360-46f5-847f-0ba092eb9993 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.911360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67df5e-f360-46f5-847f-0ba092eb9993 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.913037 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 466/929] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:39.919220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fe96-88c1-4c89-8104-c5f742b827f6 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:39.919760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fe96-88c1-4c89-8104-c5f742b827f6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:39.920273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7fe96-88c1-4c89-8104-c5f742b827f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:39.920778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 464/930] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:24:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:39.926408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:39.944644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c3a7fe96-88c1-4c89-8104-c5f742b827f6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:39.946690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c3a7fe96-88c1-4c89-8104-c5f742b827f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:40.036662 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a3990-8be2-4e9d-80bf-57a4a04a376c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.041639 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 467/931] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:40.044601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd63b-28be-493c-8665-8ba503e5030b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.045756 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd63b-28be-493c-8665-8ba503e5030b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.046287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebd63b-28be-493c-8665-8ba503e5030b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.048591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 468/932] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:40.053961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.054499 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.055245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.074540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.074989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:40.075356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.075646 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.075986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.076170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:40.088805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.090849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.100648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:40.112298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:40.113399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 465/933] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:40.114486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.163610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 469/934] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:40.163610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.209164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.241395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc6141-9956-4048-b136-2b6bdd9af7ca None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.263377 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25029b2a-101a-41c9-b86c-a127cac3ca37 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.278133 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.278979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.279260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.279545 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.280239 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.281639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:40.294631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:40.295786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.297224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 466/935] 10.222.0.16 () {56 vars in 1132 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:40.298256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.305611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.306285 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.306574 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.306857 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.307578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:40.307927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.309334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.321630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 470/936] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:40.327239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.366418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.408498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828609f4-39a3-4515-aa3b-b1938bf8f622 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.427360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0efa20-973c-4999-a9a1-ecfe84c9cbb9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.436065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.445096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.449801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.449801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.449801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.449801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.449801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.450365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: WARNING keystone.server.flask.common [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 29 23:24:40.462458 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.463137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.463430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.463710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.465109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:40.465422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.466788 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.471504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 471/937] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:40.472282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.489808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.sql.core [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:24:40.489808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 23:24:40.489808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [parameters: {'id': '73687714e19541aa99926ce867d63c52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 23:24:40.489808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=285932) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73687714e19541aa99926ce867d63c52.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73687714e19541aa99926ce867d63c52. Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:24:40.506323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result.read() Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 29 23:24:40.507507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application yield resource Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise self.value Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application session.commit() Jun 29 23:24:40.508932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:24:40.510068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:24:40.511717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result.read() Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:24:40.513034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [parameters: {'id': '73687714e19541aa99926ce867d63c52', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.515384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:40.516704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 73687714e19541aa99926ce867d63c52. Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 467/938] 10.222.0.16 () {60 vars in 1140 bytes} [Wed Jun 29 23:24:40 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:40.519170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.592433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61f489-747c-4bea-9542-03ddfd546c4f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.623891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e207d-a947-4384-9dff-175cc01b4dc9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.627379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.628211 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.628538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.628952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.637163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.638620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.647429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:40.653522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:40.654886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:40.656440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 472/939] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:40.660529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.667842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.668885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.669353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.669821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.670746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:40.671058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.672886 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.681230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 468/940] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:40.682120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.700158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.771894 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbea18-a822-431e-8319-a9f4dda84376 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.791450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83049d-c601-4256-9d3d-84d493d1fcbf None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.807016 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.807856 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.808151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.808484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.815250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.817014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.829653 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.830327 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.830612 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.830892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:40.831068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:40.832067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:40.833761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:40.834285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:40.834285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.834444 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 473/941] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:40.834444 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.838165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:40.857938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 469/942] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:40.862948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:40.909815 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.934613 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:40.943665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31d21c-3565-4bd0-a854-45b52aab1798 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.968525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064e71f-ae4d-49fb-8b9f-9fafe37fbbd4 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:40.981557 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:40.982673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:40.983630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:40.984491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:40.985907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:40.988396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.003708 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.004371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.004686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.004964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.005713 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:41.006024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.007451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.025274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 470/943] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:41.026056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.101810 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 474/944] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:41.162090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712348-7b38-4a4c-89f1-e4c9aedc99bf None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.164293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:41.215773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.216725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.217017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.217300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.230615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.232147 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:41.252806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:41.253936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:41.255049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:41.255049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:41.255049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:41.255049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:41.255049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 471/945] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:41.261451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.375807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b732-e3bb-4d28-85f8-62d79317fc37 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.411682 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.412359 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.412691 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.412972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.413697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:41.414008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.415494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.429164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 475/946] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:41.434983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.545316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10407c-fb09-4141-8cd7-730d3d864a9a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.581142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.582293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.582793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.583273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.591280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.592982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-960204bd-cb4b-4509-a479-40d4691430f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:41.608427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:41.609660 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:41.610745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:41.613049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 472/947] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:41.618922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.621989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c8ca-7db8-4eb8-9d4f-45a4a50092c2 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.622293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c8ca-7db8-4eb8-9d4f-45a4a50092c2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.622582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48c8ca-7db8-4eb8-9d4f-45a4a50092c2 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.624215 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 473/948] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:41.629712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.629947 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.630230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.647732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:41.648377 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:41.649285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:41.653628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:41.728595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 474/949] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:41.752029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.753334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e885eed-29a1-4cfd-a329-5d9abab972fc None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.789619 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.790309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.790608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.790902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.791707 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:41.792058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.793571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.810801 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 476/950] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:41.817736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.873173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6179f2c-190c-4eae-8d53-7a3f8b2c14f0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.912012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.913238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.913760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.914286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.914576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:41.915782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.917631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:41.931283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:41.936977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:41.937998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:41.938915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 475/951] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:41.939638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:41.944128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:41.955022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a5b11-e9f6-411d-8c27-6e410d64c595 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:41.991532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:41.992754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:41.993216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:41.993677 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/07f8b149fa72440bba91008f9b5bfd5a/roles/2974424f26b645508b4fba20505a7dc9` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:41.996881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=07f8b149fa72440bba91008f9b5bfd5a, role_id=2974424f26b645508b4fba20505a7dc9)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:41.998552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:42.049936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dbf2de-cd60-48b7-962f-e633eec45bdd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:42.080456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 477/952] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:24:41 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/07f8b149fa72440bba91008f9b5bfd5a/roles/2974424f26b645508b4fba20505a7dc9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:24:42.095975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:42.098877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:42.098877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:42.098877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:42.098877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:42.098877 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:42.100099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:42.108444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 476/953] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:42.113170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:42.226060 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd28064-cb91-4edd-acaa-0846aa619c37 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:42.256027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:42.265834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:42.271276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5c5e9-f6f6-449d-8085-a5689ed235fa None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:42.279410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 478/954] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:42.285550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:42.373644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:42.409084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d8b7-fce5-4484-ac69-fe86e310cfb8 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:42.445896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:42.446565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:42.446914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:42.447205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:42.447968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:42.449434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54805947-4357-42ba-b777-2c01cd2a58e5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:42.531673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 477/955] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:43.241631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a824-92c9-42a6-aeed-6be2e54482d6 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.242189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a824-92c9-42a6-aeed-6be2e54482d6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.242189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0a824-92c9-42a6-aeed-6be2e54482d6 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.243830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 479/956] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:43.249204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.249652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.249753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.267670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:43.268885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:43.316884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980b8b-b4ee-406d-8ecf-c81959636d44 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.317262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980b8b-b4ee-406d-8ecf-c81959636d44 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.317451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1980b8b-b4ee-406d-8ecf-c81959636d44 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.319126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 480/957] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:43.325366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.325696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.325927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.344298 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:43.345767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:43.351270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 478/958] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:43.375402 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.418734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 481/959] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:43.429200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:43.441241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.487009 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb381d-41a1-4279-ad2a-1fc841a177a5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.524459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:43.525518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.526018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.527181 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.528106 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:43.530216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:43.550170 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e281a5-7497-45e1-b93a-0ebf0bae83e0 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.573961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:43.576496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.sql.core [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:24:43.576496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 23:24:43.576496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [parameters: {'user_id': 'bcfea8a2976b41768a95fed6e94b5581', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 23:24:43.576496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=285932) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result.read() Jun 29 23:24:43.583977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:24:43.586735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application yield resource Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application next(self.gen) Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.session.rollback() Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.force_reraise() Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise self.value Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application session.commit() Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 29 23:24:43.587967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._prepare_impl() Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.session.flush() Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._flush(objects) Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application compat.raise_( Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application flush_context.execute() Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rec.execute(self) Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 29 23:24:43.590664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 29 23:24:43.592874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result = self._query(query) Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application conn.query(q) Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application result.read() Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 29 23:24:43.598514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bcfea8a2976b41768a95fed6e94b5581', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:43.600768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 29 23:24:43.604137 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.606556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 479/960] 10.222.0.16 () {60 vars in 1131 bytes} [Wed Jun 29 23:24:43 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:43.607565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:43.607565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.607565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.607565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.608178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:43.608178 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:43.608505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:43.624117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:43.630859 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:43.631869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:43.633390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 482/961] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:43.634138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.726462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a74175-a177-4c67-811c-90c8d4187710 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.741866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:43.756865 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b885e7-d9bb-4ac2-b47f-dd81d81802fe None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.765984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:43.766922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.767221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.767509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.775500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:43.777504 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:43.795118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:43.796496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 29 23:24:43.797853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:43.799641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:43.804435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 480/962] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:43.804667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.805572 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.805572 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.806103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] RBAC: Adding query filter params (name=compute) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:43.806419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:43.808367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:43.811899 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.816892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 483/963] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:43.826013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:43.895706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:43.922999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce023cc9-d09f-4dfb-9d77-bc9d655d5222 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.963219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:43.964121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:43.964758 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:43.965161 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:43.965323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeda405-26c3-400a-ae6e-06bb6035ea9e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:43.966169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:43.966584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:43.968262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca52839-4b78-41a7-8d68-3172d5679e71 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:44.007330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:44.008166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.008595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.008982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.009808 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] RBAC: Adding query filter params (type=compute) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:44.010224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:44.012379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063f82-44d2-4f0c-98e5-ba5ee649f9db None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:44.021016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 481/964] 10.222.0.16 () {56 vars in 1101 bytes} [Wed Jun 29 23:24:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:44.025289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 484/965] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:44.336717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2fe8-5412-4937-8e21-16019e98f00e None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.337271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2fe8-5412-4937-8e21-16019e98f00e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.337374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2fe8-5412-4937-8e21-16019e98f00e None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.338723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 482/966] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:44.344575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ace9-9a41-4346-af26-29a40d4e08af None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.345041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ace9-9a41-4346-af26-29a40d4e08af None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.345134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001ace9-9a41-4346-af26-29a40d4e08af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.362470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7001ace9-9a41-4346-af26-29a40d4e08af None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:44.363673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7001ace9-9a41-4346-af26-29a40d4e08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:44.433919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 485/967] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:44.457547 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2fe8-5412-4937-8e21-16019e98f00e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.490538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:44.563966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2fe8-5412-4937-8e21-16019e98f00e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:44.598300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:44.599047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.599337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.599621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.610449 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:44.618718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:44.619814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:44.620950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:44.621874 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 483/968] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:44.621977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd21e3-96d9-4222-b96e-71bb484970a9 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.623625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd21e3-96d9-4222-b96e-71bb484970a9 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.623625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd21e3-96d9-4222-b96e-71bb484970a9 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.624155 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 486/969] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:44.625838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.629088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.629381 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.629667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.646633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:44.647803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:44.695580 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:44.723260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:44.725052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 487/970] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:44.734386 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb216c8-ffcc-48eb-b14d-02a0f5b5645c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:44.752671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.771083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:44.771768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.772060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.772576 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.773158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:44.773475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:44.774889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:44.789447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 484/971] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:44.790450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.860997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6457-80fc-4541-bba0-b80fb795734b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:44.897309 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:44.898397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.898690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.899037 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.899702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:44.899875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f90377-c785-42f5-b039-fa07fe55a7ef None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:44.901177 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:44.913944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:44.915143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:44.917203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 488/972] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:44.921404 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.939656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:44.940500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:44.940790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:44.941115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:44.953689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:44.965078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:44.965220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:44.973629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:44.974717 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:44.975861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:44.975861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:44.975861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:44.975861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:44.975861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 485/973] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:44.980437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:44.984101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.032550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbae4e-072e-4a08-af56-6819725e6695 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.067426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.068103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.068418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.068783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.069501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:45.069820 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.071194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.076790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 489/974] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:45.082190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.087305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0a00f-00f1-48b5-a444-8dd7d98f4d96 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.125548 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.126164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.126458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.126743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.127476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:45.127792 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.129288 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.142213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 486/975] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:45.147700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.203918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe2ee2-9ed8-4750-b502-7f1363590e80 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.205789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.214861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.241894 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.242578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.242873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.243157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.243883 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:45.244200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.246221 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.251385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 490/976] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:45.254455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be937b-4d8d-4dbf-8ed1-c3c381890b8a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.257151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.291108 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.292054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.292533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.292742 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.300300 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.301797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:45.317444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:45.318588 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:45.319754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 487/977] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:45.324915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.363692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e8981-b802-43c0-9137-6b27b74102ac None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.400651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.400847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.400950 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.401238 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.402067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] RBAC: Adding query filter params (interface=admin, service_id=50ad1ad0fcd94c059cbd48c7a04a9183, region_id=RegionOne) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:45.402387 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.403757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.409238 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 491/978] 10.222.0.16 () {56 vars in 1249 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/endpoints?service_id=50ad1ad0fcd94c059cbd48c7a04a9183&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:45.414657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.431450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47da11e-d936-4c19-b285-73cd6a01b30b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.447174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.460065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.471197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.471905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.472222 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.472521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.473364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:45.473687 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.475140 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.493112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 488/979] 10.222.0.16 () {56 vars in 1149 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:45.500371 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.527886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991a84a-e986-4812-b897-1906cae467d3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.572575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.573301 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.573598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.573887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.574610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.575990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.582263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 492/980] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:24:45.621168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31476168-f50d-4340-b0cd-1c12ce0dc666 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.659746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.660337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.660676 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.661047 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:45.715956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.736396 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:45.737925 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:45.842285 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 489/981] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:24:45.847618 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:45.945393 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:45.952506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb6962-44b9-43af-b307-5f187f1be62c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:45.988250 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:45.989086 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:45.989374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:45.989655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.000017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.001519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-254a02ce-8aed-4840-8599-0c2b4813f97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:46.019584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:46.020976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:46.022127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:46.022127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:46.022127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:46.022127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:46.024480 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 493/982] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:46.027011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:46.115011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfeab9-d135-470d-8bd2-7cf33c0567dd None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.115327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfeab9-d135-470d-8bd2-7cf33c0567dd None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.115596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfeab9-d135-470d-8bd2-7cf33c0567dd None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.117011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 494/983] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:46.121876 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:46.122122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.122245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.122456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.140514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:46.141711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:46.143803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ff0e-aebd-49b6-a2cc-820216b470af None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:46.179933 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:46.180634 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.180927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.181209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.181942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:46.182255 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.183637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.194977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 490/984] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:46.200337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:46.218942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 495/985] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:46.242583 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:46.308305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba90e8-bd3e-437a-b2eb-238cad3f3070 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:46.328101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:46.343305 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:46.351028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.351028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.351028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.351769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.353270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.353501 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b023da2a-2e53-490d-be2d-a4d015e7c99d None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:46.367712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:46.369202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:46.370422 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 491/986] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:46.374675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:46.377451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:46.395769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:46.397185 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.397705 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.398057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.398778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.400144 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.476780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737396f-cfb3-428b-9186-716a269b568f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:46.490946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 496/987] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:46 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:46.529017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:46.529706 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.529996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.530276 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.531079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:46.531399 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.532925 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267f1ac-8170-40fd-bcbd-022031b8bf30 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.552262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 492/988] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:46.554293 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:46.665882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadd7dd-505c-41bc-b960-70db5f1c9901 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:46.701986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:46.702681 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:46.702972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:46.703265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:46.704127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] RBAC: Adding query filter params (role.id=2974424f26b645508b4fba20505a7dc9, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=07f8b149fa72440bba91008f9b5bfd5a) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:46.704540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:46.706045 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0d7f2-5aa1-4932-8015-1a4741826b4d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:46.709991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:46.720444 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 497/989] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:46 2022] GET /identity/v3/role_assignments?user.id=07f8b149fa72440bba91008f9b5bfd5a&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=2974424f26b645508b4fba20505a7dc9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:47.646168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895954be-aa90-42e0-bf24-dfb889fc9ca6 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:47.646743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895954be-aa90-42e0-bf24-dfb889fc9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:47.646743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895954be-aa90-42e0-bf24-dfb889fc9ca6 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:47.648243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 493/990] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:47.653319 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:47.653734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:47.653906 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:47.670809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:47.672011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:47.740779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 498/991] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:47.764973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895954be-aa90-42e0-bf24-dfb889fc9ca6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:47.825374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:47.871011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895954be-aa90-42e0-bf24-dfb889fc9ca6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:47.906433 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:47.907175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:47.907459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:47.907730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:47.908387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:47.909821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:47.922065 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:47.923263 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 29 23:24:47.924798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:47.926191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 494/992] 10.222.0.16 () {56 vars in 1126 bytes} [Wed Jun 29 23:24:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:47.929231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.031333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950d357-8c67-4237-b995-25bbb5750bc1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:48.062469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:48.068723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:48.069396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.069688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.069970 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.070680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:48.070995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:48.072464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:48.077909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 499/993] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:48.083348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.189661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb801f1-ee2a-49db-bbb3-2d86236dd024 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:48.212962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:48.224862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:48.225531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.225821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.226101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.226817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:48.227129 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:48.228572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6185a-6137-44b8-8498-dbc0e2479a86 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:48.233902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 495/994] 10.222.0.16 () {56 vars in 1122 bytes} [Wed Jun 29 23:24:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:48.239558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.343347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d1d2d-bf96-47ea-a2a1-64c08c453f10 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:48.377779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:48.378451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.378742 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.379025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.379779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:48.381201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76e9bc-135b-4aab-bdb7-3a09438077f4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:48.460511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 500/995] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:48.560823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b5b4-0544-4c12-995f-fc63b44adc18 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.561216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b5b4-0544-4c12-995f-fc63b44adc18 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.561432 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412b5b4-0544-4c12-995f-fc63b44adc18 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.562985 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 496/996] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:48.568459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907752-696c-4dc2-9770-f37a069465db None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.568786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907752-696c-4dc2-9770-f37a069465db None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.569052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5907752-696c-4dc2-9770-f37a069465db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.587047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-a5907752-696c-4dc2-9770-f37a069465db None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:48.588269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-a5907752-696c-4dc2-9770-f37a069465db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:48.643694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:48.668588 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 501/997] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:48.692015 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412b5b4-0544-4c12-995f-fc63b44adc18 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.791421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844fbe6-9aee-4f4c-8b23-78a171b9c0ec None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.791625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844fbe6-9aee-4f4c-8b23-78a171b9c0ec None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.792676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844fbe6-9aee-4f4c-8b23-78a171b9c0ec None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.795076 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 502/998] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:48.796949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412b5b4-0544-4c12-995f-fc63b44adc18 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:48.800875 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.801173 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.801460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.821469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:48.822849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:48.834058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:48.834867 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:48.835152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:48.835426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] PATH_INFO: `/v3/services/compute` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:48.836079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:48.837491 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:48.849617 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:48.851020 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:48.852054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 497/999] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:48.857527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.902014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 503/1000] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:48.912705 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:48.925534 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:48.970224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c346b-de47-4a36-8ac1-b06e43af4956 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.007855 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.008927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.009488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.009978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.011002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] RBAC: Adding query filter params (name=compute) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:49.011535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.013324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.019209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 498/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:49.024891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:49.033843 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55aac5-78b0-4985-86ff-40fe304acbb8 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.046706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:49.071613 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.072561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.072853 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.073150 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] PATH_INFO: `/v3/services/image` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.073807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.075179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:49.087441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:49.088722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:49.090273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 504/1002] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:24:48 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:49.095213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:49.137648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e44370-4d2f-44e2-bbb7-417f3825723d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.152919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:49.174066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.174837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.175236 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.175591 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.176376 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] RBAC: Adding query filter params (type=compute) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:49.176720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.178113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.184439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 499/1003] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:49.188996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:49.209276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbdb84-11f5-4dd6-9ed6-77a1cd3b7eb1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.248154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.248777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.249066 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.249348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.250059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] RBAC: Adding query filter params (name=image) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:49.250633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.251866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.262146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 505/1004] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:49.263329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:49.297688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d517afc-b7f9-4825-9e9a-62953f82581a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.305072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:49.333555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.334218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.334505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.334786 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.335572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] RBAC: Adding query filter params (interface=public, service_id=6acd790e16ac4212a590c9fa6ff879f8, region_id=RegionOne) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:49.335889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.337306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.343346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 500/1005] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:49 2022] GET /identity/v3/endpoints?service_id=6acd790e16ac4212a590c9fa6ff879f8&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:49.348770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:49.373385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1639ee9-f4d1-4a30-89a1-d659cd6c609d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.393441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:49.412447 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.413336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.413627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.413912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.414743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] RBAC: Adding query filter params (type=image) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:49.415057 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.416457 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73095da7-0b12-45f4-9042-b0661370182c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.421249 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 506/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:49.457445 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f733-767a-46fc-a1ec-a5ca4b62eeee None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:49.495589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:49.496341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:49.496664 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:49.496951 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:49.497709 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:49.499141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15875bcd-e60a-43e0-a629-07e669cbfd73 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:49.512686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 501/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:49 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 29 23:24:50.553216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ab5d-7363-4292-b409-038a9260d8d4 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:50.553741 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ab5d-7363-4292-b409-038a9260d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:50.553741 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126ab5d-7363-4292-b409-038a9260d8d4 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:50.555220 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 507/1008] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:50.560394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:50.560830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:50.561029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:50.577852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:50.579374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:50.652172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 502/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:50.675884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ab5d-7363-4292-b409-038a9260d8d4 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:50.778737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126ab5d-7363-4292-b409-038a9260d8d4 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:50.780259 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:50.812993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:50.813729 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:50.814017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:50.814509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:50.816132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:50.817625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4271556-670a-4ba7-bc06-cdc69247ff36 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:50.819404 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 508/1010] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:50.825694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:50.860170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:50.926235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e60fe5-7ae4-4966-bb17-da6d31ff5212 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:50.960442 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:50.961125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:50.961416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:50.961696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:50.962428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:50.964534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebaa1-7687-460d-af6b-a5da8f5d13f2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:51.104566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 503/1011] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:50 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:51.476124 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6409-5d82-4461-857d-ed52bff48d77 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.476320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6409-5d82-4461-857d-ed52bff48d77 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.476640 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf6409-5d82-4461-857d-ed52bff48d77 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.478159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 509/1012] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:51.483188 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.483485 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.483766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.501018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:51.502204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:51.558383 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018213-a8bc-418e-a174-1d84190a69af None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.558955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018213-a8bc-418e-a174-1d84190a69af None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.558955 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48018213-a8bc-418e-a174-1d84190a69af None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.560292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 510/1013] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:51.565262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.565556 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.565845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.573716 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 504/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:51.586267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:51.587539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:51.597341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:51.616652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:51.660275 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 511/1015] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:51.684038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:51.701389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd5beb-ce68-456a-8fb6-bc5e169b2950 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:51.738262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:51.738975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.739437 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.739727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.740545 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:51.741962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:51.780612 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:51.783711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddf15c-750f-4e0f-8535-40be7d2244d1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:51.812438 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 505/1016] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:24:51 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:51.829857 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:51.830706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:51.830988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:51.831267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] PATH_INFO: `/v3/services/compute` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:51.831942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:51.833507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:51.846704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:51.848080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 29 23:24:51.849179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:51.852849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 512/1017] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:51.854243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:51.940267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:51.966353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0cee2-e215-48d0-a16a-d75d5d506157 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:52.002189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:52.002794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:52.003086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:52.003369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:52.004079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:52.004417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:52.005828 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:52.011648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 506/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:52.017814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:52.129251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1c89-d058-4b14-99bd-131533977a25 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:52.164279 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:52.164977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:52.165271 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:52.165551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:52.166262 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:52.166575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:52.168603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c8f5f-3d8d-424a-88cf-f628e0ba16c2 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:52.178386 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 513/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Wed Jun 29 23:24:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:52.179623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:52.287050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967dc42-d761-4f28-8a04-fc2f400d6f13 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:52.322273 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:52.322948 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:52.323766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:52.324050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:52.324847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:52.326228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d41fc-87cf-4d57-9ab1-f082b5e86dbf None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:52.381303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:52.388358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 507/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:24:53.217395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa98ed-ea65-4520-9c37-abb756896d08 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.217962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa98ed-ea65-4520-9c37-abb756896d08 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.218199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa98ed-ea65-4520-9c37-abb756896d08 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.219517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 514/1021] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:53.224723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.225118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.225290 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.242843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:53.244035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:53.317773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 508/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:53.342451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa98ed-ea65-4520-9c37-abb756896d08 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:53.369198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:53.447817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa98ed-ea65-4520-9c37-abb756896d08 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:53.483191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:53.483998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.484288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.484602 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] PATH_INFO: `/v3/domains/default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.485791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:53.487244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec1f4b-0b09-4fed-84c4-cbdc157ec56e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:53.489062 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 515/1023] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:53.494569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:53.595696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd38de-e7ec-42fd-99e0-b21ee1698a26 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:53.620891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:53.632380 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:53.633103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.633391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.633677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.634490 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:53.635995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12997d-3071-458d-87cb-951ee425256e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:53.730829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 509/1024] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:24:53 2022] POST /identity/v3/users => generated 285 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:53.879633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39114fa5-350f-4a4a-b51c-e0bd1e684e35 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.879857 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39114fa5-350f-4a4a-b51c-e0bd1e684e35 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.880132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39114fa5-350f-4a4a-b51c-e0bd1e684e35 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.881809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 516/1025] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:53.887436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:53.887732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:53.888013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:53.906018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:53.907197 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:53.979540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 510/1026] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:54.002636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39114fa5-350f-4a4a-b51c-e0bd1e684e35 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.107049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:54.117373 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39114fa5-350f-4a4a-b51c-e0bd1e684e35 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.154430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.155186 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.155646 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.155933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] PATH_INFO: `/v3/services/image` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.156711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:54.158256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:54.170411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:54.171645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:54.173157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:54.176484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 517/1027] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:54.177973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.278893 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bef50-c2d4-4c9c-9ab1-3b94ba21b0dd None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.289743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:54.313539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.314217 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.314507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.314789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.315499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] RBAC: Adding query filter params (name=image) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:54.315813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:54.317264 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:54.323718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 511/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:54.329358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.433928 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0764-ee77-46b1-b029-edc0f69a1abe None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.467975 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.468698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.468992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.469277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.469992 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] RBAC: Adding query filter params (type=image) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:54.470308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:54.471689 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc1fe1-8b26-4a15-885d-b2900ca90759 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:54.481554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 518/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:54.483164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.539289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a533-f2f0-4ce0-9232-80ab92db5690 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.539644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a533-f2f0-4ce0-9232-80ab92db5690 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.539902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a533-f2f0-4ce0-9232-80ab92db5690 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.542429 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 519/1030] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:24:54.547517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.550047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.550047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.573450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:54.574846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:54.595846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:54.598369 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c8f7a-6ac5-48b7-ba0f-76223594b6db None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.637818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.638537 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.638727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.639007 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.640054 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] RBAC: Adding query filter params (interface=public, service_id=1b3b330ebef9493aad2b03c7c1a7710a, region_id=RegionOne) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:54.640368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:54.641850 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:54.651738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 512/1031] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/endpoints?service_id=1b3b330ebef9493aad2b03c7c1a7710a&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:54.652642 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.663704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 520/1032] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:54.688101 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:54.710849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:54.779832 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d10a2-0d28-4850-943b-f00b900e3f56 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.811123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef1c4a-3d13-4854-a62c-c7519dfe83eb None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:54.822234 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.823260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.823567 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.823841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.824597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:54.825958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:54.843219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 513/1033] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:24:54.857969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:54.858833 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:54.859120 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:54.859399 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:54.876413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:54.885154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:54.886463 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:54.887507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:54.892127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 521/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:54.893103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.036169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717d70e-4c95-46e2-bbf1-78ad16bc8296 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.037700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:55.070919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.071771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.072101 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.072558 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.074225 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:55.074560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.075953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:55.084246 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 514/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:24:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:55.090685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.104597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:55.193580 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac2015-3ebe-4e48-9e33-b1e9ca916c20 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.227678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.228502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.228794 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.229070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.239068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.240579 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:55.258339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:55.259414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:55.261633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:55.261633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:55.261633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:55.261633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:55.264532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 522/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:55.266095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.371158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1ab78-3f56-485c-b085-29e99eb2d784 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.405417 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.406094 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.406383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.406668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.407396 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:55.407712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.409116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:55.425963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 515/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:55.427224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.492711 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:55.534559 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d4a7a-a03e-461f-9efa-3ba43834803e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.570163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.570973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.571265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.571546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.580218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.581694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:24:55.596459 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:55.597620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:55.598803 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 523/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:55.606192 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.632958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:55.707357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ceb3-2214-46d4-9854-d48b8e9d79b3 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.741663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.742337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.742623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.742902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.743725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:55.744036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.745548 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b46d5-695f-4670-9e38-82de494e117e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:55.762878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 516/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:24:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:55.768660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:55.872620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e679a48-b903-4c40-ac2b-440ab9ecf5c1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:55.895496 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:55.906979 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117931-7784-4a8b-b90b-203539691742 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.907284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117931-7784-4a8b-b90b-203539691742 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.918091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f117931-7784-4a8b-b90b-203539691742 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.918218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:55.918329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 517/1040] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:55.918426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.918426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.918426 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.918671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:55.918671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:55.918671 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:55.933113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:55.934659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:55.988152 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:55.989661 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.013812 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 518/1041] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:56.039024 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.053922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.108217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 524/1042] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:24:56.113575 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.138726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.162274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88a6b-f9c2-455f-b6b4-21767e2cf928 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.195457 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.196262 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.196595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.196878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.207658 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:56.216166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:56.217483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:56.218842 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 519/1043] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:56.222897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cbccf-f016-46da-ad13-4dc1bd0cd432 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.226651 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.260299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.261798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.262197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.262550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.274858 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.277008 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:56.294912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:56.296134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:56.297750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:56.297750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:56.297750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:56.297750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:56.300733 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 525/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:56.301593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.307557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.338427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490ee5-5864-43f3-b2d2-b87fb771835a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.374459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.375225 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.375520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.375812 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.376594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:56.376909 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.378308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.384472 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.388114 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 520/1045] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:56.394106 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.418202 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830370d2-1c50-4fd9-b925-0568807286c7 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.457584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460723f2-1f81-4469-a846-6681251454dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.458379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460723f2-1f81-4469-a846-6681251454dd None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.458680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460723f2-1f81-4469-a846-6681251454dd None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.458968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460723f2-1f81-4469-a846-6681251454dd None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.459704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460723f2-1f81-4469-a846-6681251454dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:56.460019 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460723f2-1f81-4469-a846-6681251454dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.461447 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460723f2-1f81-4469-a846-6681251454dd None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.474300 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 526/1046] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:56.479641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460723f2-1f81-4469-a846-6681251454dd None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.501732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de4f6a-a556-4b49-b8b1-f6e83d34c9d7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.539563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.540480 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.540777 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.541062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] PATH_INFO: `/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.543170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.556442 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] RBAC: Authorizing `identity:get_user(user_id=f8e24b9f11a24166a0d5e44aedbe7a07)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.558451 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.560514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 521/1047] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07 => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:56.566276 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.591210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460723f2-1f81-4469-a846-6681251454dd None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.625604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.626412 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.626704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.626990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.628974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.634546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.636660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:24:56.651329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:56.652526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 527/1048] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:56.658627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.682187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47706a9-8183-488d-82ff-33939fe2a98d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.719639 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.720329 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.720648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.720934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.764078 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5148d6f-4613-45f3-b3fb-4f0ea4e3525b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.789759 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.800749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.811590 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126595f-615a-4e77-9b45-d70a486d5645 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.811737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.811737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.811737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.811737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.812087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:56.812087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.812087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.819009 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 528/1049] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:56.825035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.885546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:56.907821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 522/1050] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:24:56.909275 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e3e42-398b-4d43-9f39-e2791ed12789 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.909576 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e3e42-398b-4d43-9f39-e2791ed12789 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.909866 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e3e42-398b-4d43-9f39-e2791ed12789 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.911150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 523/1051] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:56.915727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e3e42-398b-4d43-9f39-e2791ed12789 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:56.930990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb77d-0e2e-430f-95c6-09c950905b1a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:56.964481 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:56.965082 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.965372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.965653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:56.966489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] RBAC: Adding query filter params (role.id=2974424f26b645508b4fba20505a7dc9, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:56.966809 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:56.968240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31324e-6c06-4b91-858d-43010881e99f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:56.974154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 529/1052] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=2974424f26b645508b4fba20505a7dc9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:56.974154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:56.974154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:56.974154 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.010517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:57.011777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:57.014007 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:57.026849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e3e42-398b-4d43-9f39-e2791ed12789 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.070167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.071068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.071359 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.071648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.072929 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.074494 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.076460 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 524/1053] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:24:56 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:57.082534 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:57.090877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 530/1054] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:57.114558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:57.171493 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:57.205414 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f51-840a-4919-9d92-ca2e055896ca None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.230571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000953c1-a1e9-497c-965e-d679089434e6 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.243043 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.243489 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.243782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.244064 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.244970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=bb0c500926324cfdab89d8338a071ca7, user.id=f8e24b9f11a24166a0d5e44aedbe7a07) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:57.245277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.246730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.260430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 525/1055] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:24:57 2022] GET /identity/v3/role_assignments?user.id=f8e24b9f11a24166a0d5e44aedbe7a07&scope.project.id=bb0c500926324cfdab89d8338a071ca7&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:57.282498 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.283422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.283779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.284124 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] PATH_INFO: `/v3/services/image` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.284907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.286384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:57.299938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:57.301503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 29 23:24:57.302755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:57.303939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 531/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Wed Jun 29 23:24:57 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:57.308807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:57.338387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:57.428339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ce6c9-efec-4c1a-97d8-5378ffa95b05 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.463214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.464424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.464731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.465014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.465724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:57.466036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.467425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.472559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 526/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:57.478454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:57.581579 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ef201-f7cb-48a4-a614-32b6e6bc8c26 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.595088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:57.616213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.616914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.617205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.617484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.618194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] RBAC: Adding query filter params (type=image) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:57.618503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.619894 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650a171-2062-4b21-958d-95e5f9fb3557 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.629474 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 532/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:57.631113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:57.722965 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:57.735283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b757b-9cdc-4691-8a5b-70be069a82a9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:57.770289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:57.770956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:57.771249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:57.771533 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:57.772274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:57.773689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73c97d-45ae-4840-8ea8-8e0769e3e8b3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:57.855773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 527/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:24:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:24:59.032518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c313d-551a-4736-b4f4-bc47c2873a68 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.033091 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c313d-551a-4736-b4f4-bc47c2873a68 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.033091 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c313d-551a-4736-b4f4-bc47c2873a68 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.034495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 533/1060] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:59.039756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8d3c-4e58-4f07-89e0-75e6d2820fc2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.040162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8d3c-4e58-4f07-89e0-75e6d2820fc2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.040365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf8d3c-4e58-4f07-89e0-75e6d2820fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.057060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-deaf8d3c-4e58-4f07-89e0-75e6d2820fc2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:59.058314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-deaf8d3c-4e58-4f07-89e0-75e6d2820fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:59.140448 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 528/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:24:59.161614 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c313d-551a-4736-b4f4-bc47c2873a68 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.266222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c313d-551a-4736-b4f4-bc47c2873a68 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.300692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.301440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.301733 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.302019 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.309027 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3668e4-51f4-4d01-bece-e02a2e8f8325 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.309335 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3668e4-51f4-4d01-bece-e02a2e8f8325 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.309629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3668e4-51f4-4d01-bece-e02a2e8f8325 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.311179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 529/1062] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:59.313269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:59.315939 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.316242 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.316566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:59.321863 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:59.323585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:59.325692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 534/1063] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:24:59.329818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.338200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:24:59.339969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:24:59.380735 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.408883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.424429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 530/1064] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:24:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:24:59.437616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.455717 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e911821-e1ed-4c4d-a432-656edea614ba None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.496355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.497273 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.497890 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.498187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.499234 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:59.499612 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:59.501789 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:59.513366 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 535/1065] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:59.519227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.547121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3421e6-a19d-43d8-a724-69a62a9a1bc5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.585592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.586395 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.586680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.587079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.598069 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:24:59.606266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:59.607398 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:24:59.608843 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 531/1066] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:59.613581 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.623190 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.627239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e97c7-fcda-40ae-ad0a-ee5b649b4a06 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.665187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.666174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.666471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.667076 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.676383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.681115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:59.683519 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:24:59.709901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:24:59.711071 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:24:59.720624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:24:59.720624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:24:59.720624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:24:59.720624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:24:59.720624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 536/1067] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:24:59.721298 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675bc8e-55c6-4cfe-bfac-a5b81aefbf45 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.721454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.753969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.754642 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.754928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.755204 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.755950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:59.756260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:59.757693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:59.772271 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 532/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:59.773540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.825414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91a32e-4506-43ed-b947-1b84469e6769 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.859038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.859630 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.859922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.860205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.860963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:24:59.861272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:59.862653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:59.876451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 537/1069] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:24:59.880395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.886153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b36d-ae9a-494c-93a2-0f3fc18d36f7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:24:59.894990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.908970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:24:59.921122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:24:59.922000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.922288 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.922569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] PATH_INFO: `/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.923823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] RBAC: Authorizing `identity:get_user(user_id=f8e24b9f11a24166a0d5e44aedbe7a07)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:24:59.925296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ae858-eeb3-4d9a-9b54-b99a613b167c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:24:59.926950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 533/1070] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:24:59.928648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1268-2ed0-459f-a053-4e503bfa55d3 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:24:59.928990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1268-2ed0-459f-a053-4e503bfa55d3 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:24:59.929277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee1268-2ed0-459f-a053-4e503bfa55d3 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:24:59.930502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 534/1071] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:24:59.933281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee1268-2ed0-459f-a053-4e503bfa55d3 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:24:59.993722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ce414-346e-47c4-846d-98662f1b4e77 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.028340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.029183 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.029460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.029739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] PATH_INFO: `/v3/users/nova` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.035835 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee1268-2ed0-459f-a053-4e503bfa55d3 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.037545 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.038993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-de3226ed-702b-4267-b105-607c5813a47e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:25:00.053566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:00.054923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:00.056112 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 538/1072] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:25:00.061478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.061780 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.062065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.103215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:00.106574 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:00.126321 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.127143 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.127434 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.127719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.128974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.130459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.132179 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 535/1073] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:24:59 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:00.132986 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.174324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.178827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 539/1074] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:00.179599 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.192541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.236076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf0eb9-389e-4d2b-9baf-2c8f768d3d39 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.270244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.270918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.271206 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.271498 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.272323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:00.272685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.274128 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.278666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507cf622-0a13-482d-be94-c8fa729aaba7 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.291824 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 536/1075] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:00.293080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.316558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.317456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.317743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.318029 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7/users/f8e24b9f11a24166a0d5e44aedbe7a07/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.320002 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c500926324cfdab89d8338a071ca7, user_id=f8e24b9f11a24166a0d5e44aedbe7a07, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.321499 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.390873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa4c23-5730-4509-b4fa-5db25fb81463 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.407205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.436440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 540/1076] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:25:00 2022] PUT /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7/users/f8e24b9f11a24166a0d5e44aedbe7a07/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:25:00.436440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.436820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.436820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.436820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.436820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.505723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.510338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.512338 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.554665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb0cc5-c9de-4965-8350-f030b336469c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.597094 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.597908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.598199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.598484 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.613390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.615308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.622467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 537/1077] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:00.628389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:25:00.633899 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:00.634959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:00.636651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:25:00.636651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:25:00.636651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:00.636651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:00.636651 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 541/1078] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:00.641687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.648360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.735297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bc124-6c2b-4c7b-a27f-b81c8c15dcf0 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.752212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bd986-367a-4278-a392-9d67e98dfbb9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.766210 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.771427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.772287 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.772594 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.772870 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.784495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.785997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.788367 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.789058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.789348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.789629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.790343 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:00.790655 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.792276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:25:00.804336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:00.805424 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:00.806727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:25:00.806727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:25:00.806727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:00.806727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:00.806999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 542/1079] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:00.808463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 538/1080] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:25:00.810332 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.814178 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:00.894927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:00.915871 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8d1a7-8a97-4287-b340-ddd79ee98b7b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.932041 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd145ba-d675-4d46-9c20-28a07bde4f1c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:00.954018 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.954833 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.956266 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.956266 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.962512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.964056 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.969284 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913004f5-b381-4581-8542-2396495f15fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:00.969967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913004f5-b381-4581-8542-2396495f15fc None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:00.970259 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913004f5-b381-4581-8542-2396495f15fc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:00.970544 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913004f5-b381-4581-8542-2396495f15fc None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:00.971278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913004f5-b381-4581-8542-2396495f15fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:00.971597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913004f5-b381-4581-8542-2396495f15fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:00.973023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913004f5-b381-4581-8542-2396495f15fc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:25:00.978256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:00.979354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 543/1081] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:25:00.999824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:01.001859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 539/1082] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:01.027573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:01.136430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e7f97-2ae3-439a-a608-ada370f3b2db None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:01.186236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:01.186236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:01.186236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:01.186236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:01.187411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:01.187411 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:01.188752 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c3cf9-92e3-40d0-b51a-14ea2433546e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:01.205023 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 544/1083] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:25:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:01.211151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913004f5-b381-4581-8542-2396495f15fc None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:01.336629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913004f5-b381-4581-8542-2396495f15fc None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:01.364892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:01.378112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:01.379118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:01.379477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:01.379850 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/2974424f26b645508b4fba20505a7dc9` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:01.382337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=38c9321d65fa472fb58ed69d3fa5c42d, role_id=2974424f26b645508b4fba20505a7dc9)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:01.383800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749445d1-4814-4e26-aaaf-773d307ef523 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:01.445504 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 540/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:25:01 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/38c9321d65fa472fb58ed69d3fa5c42d/roles/2974424f26b645508b4fba20505a7dc9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 29 23:25:02.526477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb28-ddea-4a18-8317-dff92a2e7079 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:02.526991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb28-ddea-4a18-8317-dff92a2e7079 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:02.526991 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbbb28-ddea-4a18-8317-dff92a2e7079 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:02.528334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 545/1085] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:02.533918 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:02.534349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:02.534482 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:02.550911 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:02.552094 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:02.619572 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:02.645092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbbb28-ddea-4a18-8317-dff92a2e7079 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:02.738697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:02.748687 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbbb28-ddea-4a18-8317-dff92a2e7079 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:02.782506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:02.783631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:02.783920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:02.784203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:02.794961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:02.802620 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:02.803884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:02.804974 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 546/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:02.810515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:02.904982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b5fe5-408e-454f-896c-55487df1ccd1 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:02.921970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:02.938748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:02.939416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:02.939701 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:02.939987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:02.940764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:02.941104 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:02.942471 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:02.950693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 542/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:02.956555 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.056893 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67dcfc-bb08-4a72-95e3-242fb67ee8c1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.092643 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.093551 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.093842 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.094127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] PATH_INFO: `/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.095469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e24b9f11a24166a0d5e44aedbe7a07)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:03.097022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:03.098659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 547/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:02 2022] GET /identity/v3/users/f8e24b9f11a24166a0d5e44aedbe7a07 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:03.105058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.203357 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c29ee3-21bc-4ae8-90d2-b84a52b572b7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.236807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.237459 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.237745 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.238022 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.284734 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:03.304217 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:03.305795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11908a-5c58-4af3-95fd-ec94fca93e36 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:03.403555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 543/1090] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:03.409566 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.431909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:03.519361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30d82-8f91-4c86-8f11-9d13b6f71772 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.519748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30d82-8f91-4c86-8f11-9d13b6f71772 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.520041 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a30d82-8f91-4c86-8f11-9d13b6f71772 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.521456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 544/1091] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 29 23:25:03.527057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.527349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.527629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.528605 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f360-e5a9-4cde-aaa8-9d5ba46efc02 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.544652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:03.545834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:03.562966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.563828 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.564117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.564423 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.565610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:03.567051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:03.568785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 548/1092] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:03.575317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.611970 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 545/1093] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:25:03.635265 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.647016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:03.661791 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:03.673205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9ebf8-3be9-4c05-aae2-b2d258c8d14e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.706686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.708573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.708573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.708573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.708943 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=bb0c500926324cfdab89d8338a071ca7, user.id=f8e24b9f11a24166a0d5e44aedbe7a07) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:03.709088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:03.710532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:03.717217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 549/1094] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/role_assignments?user.id=f8e24b9f11a24166a0d5e44aedbe7a07&scope.project.id=bb0c500926324cfdab89d8338a071ca7&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:03.735386 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dec770-616c-412a-84c7-a8c3eebc0633 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.772690 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.773538 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.773823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.774102 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.786394 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:03.794974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:03.796579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:03.797746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 546/1095] 10.222.0.16 () {56 vars in 1120 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:25:03.802696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:03.906805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe02e-7ebc-4f17-b6f7-8bcfaef49931 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:03.941213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:03.941818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:03.942103 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:03.942377 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:03.943125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:03.943434 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:03.944831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:03.953571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 550/1096] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:03.959499 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:04.028616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:04.059099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b03c1-af5a-4db8-9c20-67f9c362406e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:04.092943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:04.093756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:04.094048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:04.094332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:04.106291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:04.107753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:25:04.124725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:04.125829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:04.127519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:25:04.127519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:25:04.127519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:04.127519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:04.127519 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 547/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:04.131690 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:04.147869 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:04.232971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf906bb-7b44-4b2c-910b-9ac055c4acf0 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:04.266512 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:04.267186 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:04.267478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:04.267762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:04.268517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:04.268834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:04.270207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:04.282001 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 551/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:04.287551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:04.384995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426bf37-c850-48cb-aeb0-4a3006b0dba9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:04.407980 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:04.419229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:04.420032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:04.420324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:04.420635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:04.428162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:04.429686 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:25:04.443849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:04.445171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:04.446378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 548/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Wed Jun 29 23:25:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:04.451379 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:04.527263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:04.556304 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c398c6-9d79-4dcb-a8d5-af63ad7d64a3 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:04.590561 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:04.591233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:04.591524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:04.591805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:04.592673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:04.592988 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:04.594421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:04.611236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 552/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Wed Jun 29 23:25:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:04.616971 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:04.716841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf1bbe-e890-4439-ba2c-319491275a95 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:04.750416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:04.751066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:04.751358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:04.751643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:04.800675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:04.819242 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:04.820860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:04.920202 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 549/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:04.925900 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.025725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2d5d-c296-4f5e-aad5-1d6b93554bc6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:05.056351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:05.061848 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:05.062656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.062951 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.063237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.075207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:05.076729 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:25:05.094911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:05.096320 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:05.097886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:25:05.097886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:25:05.097886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:25:05.097886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:05.100754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 553/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:05.101896 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.182193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:05.200471 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c804cc0-15f4-4502-be3b-1381f2d89aa7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:05.235361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:05.236031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.236323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.236632 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.237362 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:05.237677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:05.239056 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:05.250783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 550/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:05.256348 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.354650 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089e87-8dea-488d-8b0e-3929fe7cd2a1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:05.388346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:05.389184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.389479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.389768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.396757 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:05.398212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:25:05.412431 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:05.413751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:05.414862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 554/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:25:05.420052 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.519089 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fb51-9bc9-4994-893b-fd11d64bf898 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:05.553331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:05.554001 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.554294 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.554579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.555364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:05.555682 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:05.557230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ac5ac-f1d2-4a70-89b4-418926bc1f5d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:05.569256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 551/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:05.575188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.624977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:05.679905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f9f54-6adc-41b3-b4f8-287844808ad9 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:05.712887 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:05.714043 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.714329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.714604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.715430 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] RBAC: Adding query filter params (role.id=2974424f26b645508b4fba20505a7dc9, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=38c9321d65fa472fb58ed69d3fa5c42d) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:05.715747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:05.717211 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33ac05-68d4-49ad-93a9-6633483d9f79 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:05.722923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 555/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:05 2022] GET /identity/v3/role_assignments?user.id=38c9321d65fa472fb58ed69d3fa5c42d&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=2974424f26b645508b4fba20505a7dc9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:05.784703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce3527-e030-4dbd-904c-d557f0020b19 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.785321 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce3527-e030-4dbd-904c-d557f0020b19 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.785321 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce3527-e030-4dbd-904c-d557f0020b19 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.786692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 552/1107] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:05.792685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:05.792982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:05.793264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:05.810997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:05.812218 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:05.883802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 556/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:05.909934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce3527-e030-4dbd-904c-d557f0020b19 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:05.912917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:06.015146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce3527-e030-4dbd-904c-d557f0020b19 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:06.051840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:06.052732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:06.053025 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:06.053314 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:06.054514 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:06.055976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599626f-3b2f-4213-8789-a92d263837ab None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:06.057693 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 553/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:06.063670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:06.105799 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:06.168491 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2e5cd-91d2-4520-8742-a720d7785d5b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:06.205032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:06.205714 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:06.206005 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:06.206285 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:06.207012 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:06.208482 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e450f17-51ab-4ace-836f-712ee98616f7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:06.295968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 557/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:25:06 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:08.403838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094889-7726-481f-baa7-f9c717cac616 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:08.404383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094889-7726-481f-baa7-f9c717cac616 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:08.404383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c094889-7726-481f-baa7-f9c717cac616 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:08.405738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 554/1111] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:08.410838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:08.411252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:08.411419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:08.428529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:08.429715 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:08.493982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 558/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:08.518028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c094889-7726-481f-baa7-f9c717cac616 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:08.586724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:08.618556 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c094889-7726-481f-baa7-f9c717cac616 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:08.651823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:08.652700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:08.652982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:08.653255 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] PATH_INFO: `/v3/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:08.654771 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] RBAC: Authorizing `identity:get_role(role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:08.656107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:08.657488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 555/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:08 2022] GET /identity/v3/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:08.663189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:08.687525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:08.762118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc8517-ca64-4e1f-9c5f-83b78a0ca8c4 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:08.795370 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:08.796242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:08.796565 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:08.796850 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] PATH_INFO: `/v3/users/23f9152655864704bab7bd5a3378a158` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:08.809497 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] RBAC: Authorizing `identity:get_user(user_id=23f9152655864704bab7bd5a3378a158)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:08.810944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:08.812617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 559/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:08 2022] GET /identity/v3/users/23f9152655864704bab7bd5a3378a158 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:08.818452 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:08.915296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d1c71-6051-45ad-a84e-1c9712e2228b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:08.947475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:08.948663 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:08.948950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:08.949229 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:08.957068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:09.013958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:09.015666 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:09.112597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 556/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:09.118485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:09.198686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:09.215912 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7b74-3ad6-4e39-8dee-f4a047dcdcf4 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:09.250801 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:09.251671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:09.251964 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:09.252251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:09.253477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:09.254930 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f337a-fbaf-4b16-b341-b94c5f75c02d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:09.256747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 560/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:09 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:09.263409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:09.302270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:09.360481 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdc8fe-6883-45c1-9add-e1cdf6b50a38 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:09.394286 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:09.394936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:09.395227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:09.395511 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:09.396336 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=bb0c500926324cfdab89d8338a071ca7, user.id=23f9152655864704bab7bd5a3378a158) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:09.396685 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:09.398130 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015538e-7c57-496c-9714-7a34347c88c8 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:09.403476 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 557/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:09 2022] GET /identity/v3/role_assignments?user.id=23f9152655864704bab7bd5a3378a158&scope.project.id=bb0c500926324cfdab89d8338a071ca7&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:11.423966 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17141-1826-4ef8-ad5f-eac1410f9545 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:11.424530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17141-1826-4ef8-ad5f-eac1410f9545 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:11.424530 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17141-1826-4ef8-ad5f-eac1410f9545 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:11.425857 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 561/1118] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:11.431184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:11.431582 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:11.431754 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:11.449355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:11.450542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:11.515679 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 558/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:11.538814 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a17141-1826-4ef8-ad5f-eac1410f9545 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:11.638694 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a17141-1826-4ef8-ad5f-eac1410f9545 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:11.671502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3680906-072b-494c-bb99-961950be3dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:11.672350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3680906-072b-494c-bb99-961950be3dba None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:11.672680 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3680906-072b-494c-bb99-961950be3dba None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:11.672969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3680906-072b-494c-bb99-961950be3dba None admin] PATH_INFO: `/v3/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:11.674514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3680906-072b-494c-bb99-961950be3dba None admin] RBAC: Authorizing `identity:get_role(role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:11.675847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3680906-072b-494c-bb99-961950be3dba None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:11.677236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 562/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:11 2022] GET /identity/v3/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:11.683245 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:11.713156 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:11.780163 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09a54e-e7f3-4abf-b072-f6b15cca3c86 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:11.814360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:11.815220 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:11.815506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:11.815780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] PATH_INFO: `/v3/users/23f9152655864704bab7bd5a3378a158` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:11.816987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=23f9152655864704bab7bd5a3378a158)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:11.818420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:11.820006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 559/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:11 2022] GET /identity/v3/users/23f9152655864704bab7bd5a3378a158 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:11.825743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3680906-072b-494c-bb99-961950be3dba None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:11.852475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:11.931649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3680906-072b-494c-bb99-961950be3dba None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:11.965571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:11.966428 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:11.966725 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:11.967010 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:11.968197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:11.969665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d72a3f-d145-4644-b18d-696340ecac89 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:11.971342 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 563/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:11 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:11.977123 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:12.072059 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:12.074969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a59c7-3581-4b32-abac-2d39ed7a5bf9 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:12.109366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:12.110261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:12.110553 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:12.110834 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7/users/23f9152655864704bab7bd5a3378a158/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:12.113076 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb0c500926324cfdab89d8338a071ca7, user_id=23f9152655864704bab7bd5a3378a158, role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:12.114522 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc167a-394c-4358-9ca6-bf78163b30f3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:12.180267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 560/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:25:11 2022] PUT /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7/users/23f9152655864704bab7bd5a3378a158/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:25:14.188245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519cdf-8df6-43af-8978-1e3610296a24 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:14.188840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519cdf-8df6-43af-8978-1e3610296a24 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:14.188840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e519cdf-8df6-43af-8978-1e3610296a24 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:14.190216 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 564/1124] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:14.195309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff4df-5458-458f-845c-65b104943c71 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:14.195741 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff4df-5458-458f-845c-65b104943c71 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:14.195854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ff4df-5458-458f-845c-65b104943c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:14.212825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-752ff4df-5458-458f-845c-65b104943c71 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:14.214585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-752ff4df-5458-458f-845c-65b104943c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:14.279332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 561/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:14.302993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519cdf-8df6-43af-8978-1e3610296a24 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:14.387548 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:14.402958 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e519cdf-8df6-43af-8978-1e3610296a24 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:14.436380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:14.437267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:14.437554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:14.437834 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] PATH_INFO: `/v3/roles/8eee563e9bb54fa186d39af8ca4426ab` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:14.439317 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] RBAC: Authorizing `identity:get_role(role_id=8eee563e9bb54fa186d39af8ca4426ab)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:14.440716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:14.442070 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 565/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:14 2022] GET /identity/v3/roles/8eee563e9bb54fa186d39af8ca4426ab => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:14.448441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff4df-5458-458f-845c-65b104943c71 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:14.534967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:14.543840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ff4df-5458-458f-845c-65b104943c71 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:14.577234 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:14.578096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:14.578381 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:14.578661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] PATH_INFO: `/v3/users/23f9152655864704bab7bd5a3378a158` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:14.579850 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] RBAC: Authorizing `identity:get_user(user_id=23f9152655864704bab7bd5a3378a158)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:14.581324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:14.582944 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 562/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:14 2022] GET /identity/v3/users/23f9152655864704bab7bd5a3378a158 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:14.588732 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:14.685885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344955a-c286-4bb6-ab08-6929d0efba1b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:14.718931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:14.719570 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:14.719860 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:14.720143 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:14.742856 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:14.785569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:14.787360 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:14.882613 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 566/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:14.888621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:14.989410 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fb6eb-3d22-44ad-8bf9-6cc02806576f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:15.022706 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:15.023558 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:15.023844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:15.024120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] PATH_INFO: `/v3/projects/bb0c500926324cfdab89d8338a071ca7` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:15.025331 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] RBAC: Authorizing `identity:get_project(project_id=bb0c500926324cfdab89d8338a071ca7)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:15.026795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6ea7f-1fd9-4f6c-876c-8b1f4a5e4b08 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:15.028502 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 563/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:14 2022] GET /identity/v3/projects/bb0c500926324cfdab89d8338a071ca7 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:15.034597 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:15.088384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:15.133654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d988d-1586-4fca-8e4c-beb0861cc25f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:15.166268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:15.167461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:15.167747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:15.168027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:15.168880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] RBAC: Adding query filter params (role.id=8eee563e9bb54fa186d39af8ca4426ab, scope.project.id=bb0c500926324cfdab89d8338a071ca7, user.id=23f9152655864704bab7bd5a3378a158) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:15.169197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:15.170623 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db753b-06bd-4bb2-82f3-781a44b46578 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:15.176272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 567/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:15 2022] GET /identity/v3/role_assignments?user.id=23f9152655864704bab7bd5a3378a158&scope.project.id=bb0c500926324cfdab89d8338a071ca7&role.id=8eee563e9bb54fa186d39af8ca4426ab => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:17.227506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8d5fc-1ccd-4a00-8462-261a1bf6cdc0 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:17.228036 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8d5fc-1ccd-4a00-8462-261a1bf6cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:17.228165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8d5fc-1ccd-4a00-8462-261a1bf6cdc0 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:17.229485 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 564/1131] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:17.234700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:17.235149 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:17.235256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:17.251669 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:17.252870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:17.317721 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 568/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:17.341879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8d5fc-1ccd-4a00-8462-261a1bf6cdc0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:17.368785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:17.443989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8d5fc-1ccd-4a00-8462-261a1bf6cdc0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:17.476838 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:17.477628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:17.477922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:17.478207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:17.479420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:17.480902 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345ddd5-c767-430b-bd10-5ac132869be4 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:17.482517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 565/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:17.488340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:17.536751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:17.586542 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb1068-41a0-4f04-8359-e294ba44867d None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:17.618629 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:17.619322 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:17.620080 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:17.620361 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:17.621087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:17.622511 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d593b-7e3a-4de9-98f8-575c56305541 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:17.690187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 569/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:25:17 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:19.742118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68faa-3d99-4773-8316-7faccdf484f0 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:19.742696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68faa-3d99-4773-8316-7faccdf484f0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:19.742696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e68faa-3d99-4773-8316-7faccdf484f0 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:19.744058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 566/1135] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:19.749790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:19.750217 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:19.750358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:19.767636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:19.768846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:19.833115 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 570/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:19.857341 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68faa-3d99-4773-8316-7faccdf484f0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:19.949119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:19.956366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e68faa-3d99-4773-8316-7faccdf484f0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:19.989680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:19.990464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:19.990751 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:19.991032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:19.992260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:19.993683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1afec5-fbcf-46d3-b707-6ab435bdbc9b None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:19.995798 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 567/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:25:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:20.001520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:20.032130 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:20.099977 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43acf-fa04-4728-9243-ef43d5d00a38 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:20.134751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:20.135455 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:20.135745 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:20.136026 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:20.136778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:20.138214 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b8b9-dd79-483f-a576-f35eb2542150 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:20.224648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 571/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:25:20 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:22.282084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b742e4c-cf91-4943-a825-1f0a9921db52 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:22.282640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b742e4c-cf91-4943-a825-1f0a9921db52 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:22.282640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b742e4c-cf91-4943-a825-1f0a9921db52 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:22.284014 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 568/1139] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:22.289105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:22.289515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:22.289672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:22.306382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:22.308087 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:22.374391 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 572/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:22.398605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b742e4c-cf91-4943-a825-1f0a9921db52 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:22.512774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b742e4c-cf91-4943-a825-1f0a9921db52 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:22.545526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:22.546307 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:22.546592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:22.546867 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:22.556587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:22.564266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:22.565668 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:22.566987 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 569/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:22.571449 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:22.589495 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:22.668286 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d5868-a6bb-4310-b1b3-4de33b88cd9e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:22.701787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:22.702445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:22.702731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:22.703013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:22.703760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:22.704090 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:22.705490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:22.713298 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 573/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:22.718853 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:22.743034 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:22.817194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0762-b349-449b-8dad-2a276e233b60 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:22.849981 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:22.850837 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:22.851122 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:22.851401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] PATH_INFO: `/v3/users/bf115c5386834d64bc253a4f180e837e` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:22.864000 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] RBAC: Authorizing `identity:get_user(user_id=bf115c5386834d64bc253a4f180e837e)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:22.865508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:22.867166 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 570/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:22 2022] GET /identity/v3/users/bf115c5386834d64bc253a4f180e837e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:22.873419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:22.951330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:22.971524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29befcb8-9149-48dc-aab9-6df4a664b684 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:23.004548 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:23.005192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:23.005482 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:23.005763 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:23.072525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:23.073980 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:23.149022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:23.170632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 574/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:25:23.176619 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:23.257012 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:23.275278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad491-5f01-4f47-85c5-1a3f65a44363 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:23.308937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:23.309793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:23.310084 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:23.310365 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] PATH_INFO: `/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:23.311559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f4c7b700fadd4f498440cb7b2f8826ef)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:23.313017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6641e-60b3-436e-8729-101ab18a00b5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:23.314697 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 571/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:23 2022] GET /identity/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:23.320688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:23.416877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956f49e-38f6-4153-8789-2c30d2052a25 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:23.448979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:23.449631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:23.449918 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:23.450200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:23.451021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=f4c7b700fadd4f498440cb7b2f8826ef, user.id=bf115c5386834d64bc253a4f180e837e) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:23.451336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:23.452795 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d293c5-961e-49a2-8908-fdb2dfc234e0 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:23.458209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 575/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:23 2022] GET /identity/v3/role_assignments?user.id=bf115c5386834d64bc253a4f180e837e&scope.project.id=f4c7b700fadd4f498440cb7b2f8826ef&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:25.441368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bcf7-5977-435f-9c98-d0aa1c263f41 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:25.441903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bcf7-5977-435f-9c98-d0aa1c263f41 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:25.441903 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35bcf7-5977-435f-9c98-d0aa1c263f41 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:25.443302 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 572/1147] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:25.449092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:25.449532 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:25.449646 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:25.466634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:25.467811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:25.501631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:25.533350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 576/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:25.555981 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35bcf7-5977-435f-9c98-d0aa1c263f41 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:25.656616 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35bcf7-5977-435f-9c98-d0aa1c263f41 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:25.689444 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:25.690236 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:25.690527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:25.690819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:25.701356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:25.709017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:25.710292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:25.711680 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 573/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:25.716730 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:25.811897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48ac6a-380e-4993-9796-6c1ab5cde942 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:25.844782 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:25.845441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:25.845731 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:25.846014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:25.846760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:25.847074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:25.848475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:25.856940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 577/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:25.862529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:25.873808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:25.961261 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039e95-307a-4c40-92a6-9245c4290949 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:25.994592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:25.995466 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:25.995756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:25.996041 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] PATH_INFO: `/v3/users/bf115c5386834d64bc253a4f180e837e` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:25.997339 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] RBAC: Authorizing `identity:get_user(user_id=bf115c5386834d64bc253a4f180e837e)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:25.998795 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:26.000423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 574/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:25 2022] GET /identity/v3/users/bf115c5386834d64bc253a4f180e837e => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:26.006068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:26.041118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:26.106291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d0f63-bea6-471d-90b4-741e233c9a4c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:26.140162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:26.141315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:26.141604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:26.141885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] PATH_INFO: `/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:26.143065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] RBAC: Authorizing `identity:get_project(project_id=f4c7b700fadd4f498440cb7b2f8826ef)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:26.144522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27abc94-414e-4d87-bc4d-87a6ecf8cd01 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:26.146198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 578/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:26 2022] GET /identity/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:26.152723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:26.228473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:26.250297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981932-97ef-426c-9019-71503ddfe333 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:26.284283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:26.285206 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:26.285497 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:26.285777 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] PATH_INFO: `/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef/users/bf115c5386834d64bc253a4f180e837e/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:26.287749 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] RBAC: Authorizing `identity:create_grant(project_id=f4c7b700fadd4f498440cb7b2f8826ef, user_id=bf115c5386834d64bc253a4f180e837e, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:26.289231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0c69-60cb-43dd-b346-8fe3684ea105 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:26.380453 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 575/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:25:26 2022] PUT /identity/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef/users/bf115c5386834d64bc253a4f180e837e/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:25:28.377206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef87e-c33b-4e26-9617-7aa5b6358cf7 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:28.377738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef87e-c33b-4e26-9617-7aa5b6358cf7 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:28.377738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef87e-c33b-4e26-9617-7aa5b6358cf7 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:28.379054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 579/1154] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:28.384372 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:28.384829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:28.385484 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:28.402698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:28.403867 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:28.467304 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 576/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:28.491161 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef87e-c33b-4e26-9617-7aa5b6358cf7 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:28.591901 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef87e-c33b-4e26-9617-7aa5b6358cf7 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:28.593453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:28.625982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:28.626777 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:28.627069 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:28.627403 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:28.638074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:28.645933 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:28.647227 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:28.648632 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 580/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:28.653322 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:28.716907 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:28.751037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c861d-92e4-425e-a1b3-98458eb3fd06 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:28.784849 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:28.785515 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:28.785806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:28.786091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:28.786841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:28.787154 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:28.788562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:28.796541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 577/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:28.802278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:28.900284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25b980-90a6-48d9-8bf2-f31e9ab858e5 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:28.932962 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:28.933816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:28.934105 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:28.934384 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] PATH_INFO: `/v3/users/bf115c5386834d64bc253a4f180e837e` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:28.935571 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] RBAC: Authorizing `identity:get_user(user_id=bf115c5386834d64bc253a4f180e837e)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:28.937051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:28.938660 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 581/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:28 2022] GET /identity/v3/users/bf115c5386834d64bc253a4f180e837e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:25:28.944231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:29.040461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d19a-c04e-4b3a-ad39-a0c70c955e8a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:29.066080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:29.073428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b371d-826e-4509-b247-a87decddba89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:29.074066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b371d-826e-4509-b247-a87decddba89 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:29.074353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b371d-826e-4509-b247-a87decddba89 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:29.074635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b371d-826e-4509-b247-a87decddba89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:29.139880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b371d-826e-4509-b247-a87decddba89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:29.141644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b371d-826e-4509-b247-a87decddba89 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:29.236605 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 578/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:29.242531 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:29.273507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:29.341405 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa011d-5d9d-4209-90d9-484c02461747 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:29.375454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:29.376313 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:29.376636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:29.376924 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] PATH_INFO: `/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:29.378114 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] RBAC: Authorizing `identity:get_project(project_id=f4c7b700fadd4f498440cb7b2f8826ef)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:29.379558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171c254-7d91-41bd-82bd-4519209ead7e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:29.381278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 582/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:29 2022] GET /identity/v3/projects/f4c7b700fadd4f498440cb7b2f8826ef => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:29.387423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b371d-826e-4509-b247-a87decddba89 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:29.414733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:29.484879 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b371d-826e-4509-b247-a87decddba89 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:29.517760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:29.518349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:29.518640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:29.518924 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:29.519748 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=f4c7b700fadd4f498440cb7b2f8826ef, user.id=bf115c5386834d64bc253a4f180e837e) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:29.520068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:29.521543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0d4fb-3d8e-4f69-8633-e6a51408eb63 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:29.527753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 579/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:29 2022] GET /identity/v3/role_assignments?user.id=bf115c5386834d64bc253a4f180e837e&scope.project.id=f4c7b700fadd4f498440cb7b2f8826ef&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:31.587686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1fbd-dcb1-4ac0-b253-f1dad4f1593f None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:31.588787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1fbd-dcb1-4ac0-b253-f1dad4f1593f None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:31.588910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1fbd-dcb1-4ac0-b253-f1dad4f1593f None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:31.590233 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 583/1162] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:31.595464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:31.595914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:31.596030 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:31.612516 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:31.613729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:31.680508 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 580/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:31.703790 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb1fbd-dcb1-4ac0-b253-f1dad4f1593f None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:31.797410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:31.801921 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb1fbd-dcb1-4ac0-b253-f1dad4f1593f None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:31.835000 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:31.835710 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:31.836194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:31.836670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:31.901327 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:31.902712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:31.992961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:31.997877 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 584/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:32.003739 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:32.027926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:32.102654 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4b9fc-e12a-4dd6-a5ff-126bc4e4202f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:32.136348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:32.137183 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:32.137473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:32.137755 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:32.144629 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:32.146078 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-c141dba4-b486-4835-9816-6f04fc1b385c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:32.160099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:32.161615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:32.162856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 581/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:25:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:32.167700 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:32.262390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b4abb-abfd-4b1c-b2f1-b0981a0bc20c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:32.295032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:32.295685 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:32.295969 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:32.296251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:32.296995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:32.297306 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:32.298657 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd6c38-3b2c-4895-8de5-1e452f9a98cf None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:32.305601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 585/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Wed Jun 29 23:25:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:34.320361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62588-82b4-462f-b945-c3523977991e None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:34.321055 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62588-82b4-462f-b945-c3523977991e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:34.321055 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb62588-82b4-462f-b945-c3523977991e None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:34.322817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 582/1167] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:34.328201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f7f-ffb1-46d5-a9d3-0247f8928fe4 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:34.328678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f7f-ffb1-46d5-a9d3-0247f8928fe4 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:34.328831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f7f-ffb1-46d5-a9d3-0247f8928fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:34.345919 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-656e3f7f-ffb1-46d5-a9d3-0247f8928fe4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:34.347047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-656e3f7f-ffb1-46d5-a9d3-0247f8928fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:34.402451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:34.412516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 586/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:34.436218 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62588-82b4-462f-b945-c3523977991e None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:34.517231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:34.535615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb62588-82b4-462f-b945-c3523977991e None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:34.567743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:34.568388 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:34.568702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:34.568981 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:34.569724 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:34.571085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacf590-f1af-46dc-8720-1ac93fb3a8cc None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:34.640005 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 583/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Wed Jun 29 23:25:34 2022] POST /identity/v3/domains => generated 267 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:36.675855 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3f3f-a65d-46d5-afb7-f4700f7e2709 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:36.676476 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3f3f-a65d-46d5-afb7-f4700f7e2709 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:36.676476 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b3f3f-a65d-46d5-afb7-f4700f7e2709 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:36.677838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 587/1170] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:36.683631 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:36.684081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:36.684191 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:36.700727 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:36.701908 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:36.767537 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 584/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:36.790739 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3f3f-a65d-46d5-afb7-f4700f7e2709 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:36.891547 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b3f3f-a65d-46d5-afb7-f4700f7e2709 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:36.925778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:36.926692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:36.926935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:36.927219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] PATH_INFO: `/v3/domains/2bc0062bc4944e64b1e53d17f08df6ea` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:36.937546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2bc0062bc4944e64b1e53d17f08df6ea)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:36.938996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e001608-d64a-4323-a8e6-3e599a04c295 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:36.940649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 588/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 23:25:36 2022] GET /identity/v3/domains/2bc0062bc4944e64b1e53d17f08df6ea => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:36.946657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:37.013963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:37.043035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8217ba-94d5-45b8-9c90-30dc644cc63d None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:37.076046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:37.076743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:37.077035 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:37.077320 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:37.078023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:37.079469 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40656ecc-94d5-4b06-9df5-fb8171182ffe None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:37.171349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 585/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:25:36 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:39.212517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5d2-ba45-4a03-a776-3badf93b4517 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:39.213129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5d2-ba45-4a03-a776-3badf93b4517 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:39.213129 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3e5d2-ba45-4a03-a776-3badf93b4517 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:39.214451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 589/1174] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:39.219649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378658da-62fd-426c-a71e-318334fc8547 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:39.220067 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378658da-62fd-426c-a71e-318334fc8547 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:39.220221 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378658da-62fd-426c-a71e-318334fc8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:39.236746 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-378658da-62fd-426c-a71e-318334fc8547 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:39.237917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-378658da-62fd-426c-a71e-318334fc8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:39.302050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 586/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:39.327704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e5d2-ba45-4a03-a776-3badf93b4517 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:39.380569 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:39.427703 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3e5d2-ba45-4a03-a776-3badf93b4517 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:39.460942 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:39.461800 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:39.462092 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:39.462374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] PATH_INFO: `/v3/domains/2bc0062bc4944e64b1e53d17f08df6ea` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:39.463582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2bc0062bc4944e64b1e53d17f08df6ea)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:39.465055 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc51ec1-9188-424d-b4cb-36b076bcd840 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:39.466646 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 590/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Wed Jun 29 23:25:39 2022] GET /identity/v3/domains/2bc0062bc4944e64b1e53d17f08df6ea => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:39.472356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378658da-62fd-426c-a71e-318334fc8547 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:39.526465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:39.570347 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378658da-62fd-426c-a71e-318334fc8547 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:39.602912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:39.604097 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:39.604389 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:39.604704 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:39.605420 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:39.606854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebccf86-6519-435a-bc49-0223d90b2cd1 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:39.699531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 587/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:25:39 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:25:41.770042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a1cb-4d9b-4ad4-ad3c-03e29babf131 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:41.770610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a1cb-4d9b-4ad4-ad3c-03e29babf131 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:41.770610 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a1cb-4d9b-4ad4-ad3c-03e29babf131 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:41.771981 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 591/1178] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:41.777198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:41.777681 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:41.777802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:41.794683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:41.795864 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:41.860804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 588/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:41.884450 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a1cb-4d9b-4ad4-ad3c-03e29babf131 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:41.984550 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a1cb-4d9b-4ad4-ad3c-03e29babf131 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.004515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:42.018219 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.019010 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.019296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.019636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.030118 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:42.037767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:42.039179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:42.040546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 592/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:42.045401 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:42.085332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:42.141602 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4880e5-44f8-45bb-b907-2d021a9cf7f4 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.175732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.176425 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.176718 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.176997 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.177743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:42.178051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:42.179418 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:42.187239 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 589/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:42.193081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:42.292319 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623ba7a-414c-482d-b1ec-cebfc4a7e756 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.324414 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.325299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.325591 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.325874 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] PATH_INFO: `/v3/users/c787f4746a494b5c86e01dd87dffa1e9` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.339088 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] RBAC: Authorizing `identity:get_user(user_id=c787f4746a494b5c86e01dd87dffa1e9)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:42.340587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:42.342201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 593/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:42 2022] GET /identity/v3/users/c787f4746a494b5c86e01dd87dffa1e9 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:42.347735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:42.445049 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bcff2-dca3-4c43-babc-b76a05003b87 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.446539 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:42.479216 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.480176 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.480488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.480768 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.545045 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:42.546447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:42.640092 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 590/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:42.646127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:42.685138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:42.743675 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfe8fd-7dc1-4ab4-84a2-13918feb50ae None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.777825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.778695 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.778985 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.779265 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] PATH_INFO: `/v3/projects/dafc9a829ea74eef988ff273ea0c8e43` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.780468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=dafc9a829ea74eef988ff273ea0c8e43)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:42.781911 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d8ac9-a40d-4023-bf93-238170c28eb9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:42.783592 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 594/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:42 2022] GET /identity/v3/projects/dafc9a829ea74eef988ff273ea0c8e43 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:42.789759 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:42.791919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:42.886019 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d948b1-99cf-4b6e-b078-baec19ee0e2f None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:42.918904 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:42.919541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:42.919829 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:42.920107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:42.920961 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=dafc9a829ea74eef988ff273ea0c8e43, user.id=c787f4746a494b5c86e01dd87dffa1e9) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:42.921275 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:42.922706 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde12420-685a-4804-8b0d-a6067cb8555e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:42.928136 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 591/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:42 2022] GET /identity/v3/role_assignments?user.id=c787f4746a494b5c86e01dd87dffa1e9&scope.project.id=dafc9a829ea74eef988ff273ea0c8e43&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:44.937475 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5aa2a-781c-4e9b-bfd7-8a45d3fc11e5 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:44.938052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5aa2a-781c-4e9b-bfd7-8a45d3fc11e5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:44.938052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5aa2a-781c-4e9b-bfd7-8a45d3fc11e5 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:44.939395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 595/1186] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:44.944597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:44.945044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:44.945164 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:44.962081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:44.963934 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:45.021352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:45.029223 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 592/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:45.051588 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5aa2a-781c-4e9b-bfd7-8a45d3fc11e5 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:45.151489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5aa2a-781c-4e9b-bfd7-8a45d3fc11e5 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:45.158631 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:45.184413 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:45.185229 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:45.185518 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:45.185801 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:45.196272 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:45.204473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:45.205769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:25:45.207041 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 596/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:45.211772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:45.307585 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f725-ce68-4570-89cb-83d0a59631e5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:45.340526 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:45.341187 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:45.341477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:45.341763 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:45.342505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:45.342821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:45.344200 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:45.352060 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 593/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:45.357849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:45.455693 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5d467-d130-4528-8463-74dd01ddcbf6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:45.487589 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:45.488458 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:45.488743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:45.489016 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] PATH_INFO: `/v3/users/c787f4746a494b5c86e01dd87dffa1e9` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:45.490193 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] RBAC: Authorizing `identity:get_user(user_id=c787f4746a494b5c86e01dd87dffa1e9)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:45.491648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:45.493267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 597/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:45 2022] GET /identity/v3/users/c787f4746a494b5c86e01dd87dffa1e9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:45.499309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:45.556213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:45.596878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6c46c-81cf-457e-996c-e09eed7d77cf None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:45.629859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:45.630710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:45.630999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:45.631281 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] PATH_INFO: `/v3/projects/dafc9a829ea74eef988ff273ea0c8e43` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:45.632488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] RBAC: Authorizing `identity:get_project(project_id=dafc9a829ea74eef988ff273ea0c8e43)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:45.633945 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d7b32-6e22-48da-aec0-5e1f72f6deea None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:45.635662 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 594/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:45 2022] GET /identity/v3/projects/dafc9a829ea74eef988ff273ea0c8e43 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:45.641644 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:45.675171 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:45.738798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fdbf-1468-43fc-a667-60c82cb50a40 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:45.772138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:45.773042 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:45.773329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:45.773607 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] PATH_INFO: `/v3/projects/dafc9a829ea74eef988ff273ea0c8e43/users/c787f4746a494b5c86e01dd87dffa1e9/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:45.775578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] RBAC: Authorizing `identity:create_grant(project_id=dafc9a829ea74eef988ff273ea0c8e43, user_id=c787f4746a494b5c86e01dd87dffa1e9, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:45.777047 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab21e6-97d0-4e47-a4c6-b569a0b1ae29 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:45.849503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 598/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:25:45 2022] PUT /identity/v3/projects/dafc9a829ea74eef988ff273ea0c8e43/users/c787f4746a494b5c86e01dd87dffa1e9/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:25:47.877267 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8acc2-6df9-4476-a5aa-1012d93413e2 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:47.877854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8acc2-6df9-4476-a5aa-1012d93413e2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:47.877854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8acc2-6df9-4476-a5aa-1012d93413e2 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:47.879205 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 595/1193] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:25:47.884292 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:47.885207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:47.885380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:47.903236 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:25:47.904479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:25:47.969290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 599/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:25:47.992667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8acc2-6df9-4476-a5aa-1012d93413e2 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.092747 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8acc2-6df9-4476-a5aa-1012d93413e2 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:48.118447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:48.142852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:48.142852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:48.142852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:48.142852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:48.143309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:25:48.148764 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:25:48.150028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:25:48.151507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 596/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:25:48.156015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.179838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:48.252914 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ec886-851c-4927-8f63-34cf05093ef6 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:48.286205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:48.286866 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:48.287156 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:48.287441 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:48.288186 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:48.288528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:48.289895 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:48.297766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 600/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:48.303370 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.400943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a696c8a-cdbe-4bae-bc50-c08a59b5c244 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:48.433251 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:48.434119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:48.434400 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:48.434672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] PATH_INFO: `/v3/users/c787f4746a494b5c86e01dd87dffa1e9` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:48.435854 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] RBAC: Authorizing `identity:get_user(user_id=c787f4746a494b5c86e01dd87dffa1e9)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:48.437312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:48.438914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 597/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Wed Jun 29 23:25:48 2022] GET /identity/v3/users/c787f4746a494b5c86e01dd87dffa1e9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:48.444686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.528239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:48.542421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ac1f9-2ce9-4208-9a0e-5b6f8bdb2a13 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:48.575656 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:48.576298 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:48.576624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:48.576910 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:48.641733 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:48.643167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:48.723673 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:48.738535 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 601/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:25:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:25:48.744235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.798058 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:48.842070 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f4d9-aaec-440d-bacb-cc8a0c50b58c None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:48.874435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:48.875292 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:48.875573 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:48.875847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] PATH_INFO: `/v3/projects/dafc9a829ea74eef988ff273ea0c8e43` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:48.877031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] RBAC: Authorizing `identity:get_project(project_id=dafc9a829ea74eef988ff273ea0c8e43)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:48.878467 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697abd17-2f66-4e18-ab5b-1e75f2e965cb None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:48.880147 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 598/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Wed Jun 29 23:25:48 2022] GET /identity/v3/projects/dafc9a829ea74eef988ff273ea0c8e43 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:48.886785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:25:48.983768 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a81361-1cb8-4bdd-9ccf-e48e8cc3e90e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:25:49.016022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:25:49.016957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:25:49.017245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:25:49.017525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:25:49.018350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=dafc9a829ea74eef988ff273ea0c8e43, user.id=c787f4746a494b5c86e01dd87dffa1e9) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:25:49.018666 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:25:49.020094 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3f763-0ac6-4a55-a0bb-6169e3f20b80 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:25:49.026325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 602/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:25:48 2022] GET /identity/v3/role_assignments?user.id=c787f4746a494b5c86e01dd87dffa1e9&scope.project.id=dafc9a829ea74eef988ff273ea0c8e43&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:25:58.870356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=39 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:25:59.023179 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=75 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:03.034400 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb173-e2db-4685-b8c6-7a4171d07391 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:03.035018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb173-e2db-4685-b8c6-7a4171d07391 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:03.035018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb173-e2db-4685-b8c6-7a4171d07391 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:03.036342 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 599/1201] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:03.041641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:03.042334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:03.042334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:03.059989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:03.061206 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:03.130282 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 603/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:03.156057 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb173-e2db-4685-b8c6-7a4171d07391 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:03.256447 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb173-e2db-4685-b8c6-7a4171d07391 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:03.292673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:03.293348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:03.293637 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:03.293919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:03.304732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:03.306189 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:03.323430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:03.327317 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:03.328805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:03.328805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:03.328805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:03.328805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:03.328805 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 600/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:03.330714 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:03.429003 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ffb59-a948-47cd-874a-beb67eedcea3 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:03.457073 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:03.462779 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:03.463439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:03.463723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:03.464023 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:03.464785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:03.465095 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:03.467096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f34c31-0e9c-449f-b397-c52ec6f48827 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:03.480882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 604/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:03.486505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:03.537683 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:03.584793 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb34314-fbd9-4109-9a92-eb9a85d4f28e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:03.618415 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:03.619079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:03.619366 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:03.619652 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:03.620346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:03.621814 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7d97-8c0f-47ca-be54-1e661d4b33d3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:03.729848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 601/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Wed Jun 29 23:27:03 2022] POST /identity/v3/users => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:27:05.779802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6b91-a1ee-4589-91b1-f79e929c42c1 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:05.780418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6b91-a1ee-4589-91b1-f79e929c42c1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:05.780418 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d6b91-a1ee-4589-91b1-f79e929c42c1 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:05.781807 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 605/1206] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:05.787066 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:05.787506 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:05.787623 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:05.804977 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:05.810802 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:05.872118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 602/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:05.896554 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d6b91-a1ee-4589-91b1-f79e929c42c1 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:05.997505 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d6b91-a1ee-4589-91b1-f79e929c42c1 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.031826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.032593 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.032879 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.033158 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.043189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:06.051624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:06.053096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:06.054294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 606/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:27:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:27:06.059091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.100486 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:06.170560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8d006-b04a-4494-a01b-722c543ef3a0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.212133 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.212860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.213157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.213446 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.214207 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:06.214517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:06.215917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:06.224614 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 603/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:06.230468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.282270 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:06.332726 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2be9c-f013-4434-80b3-ee9fb870e7fc None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.367971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.368804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.369093 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.369372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.379908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:06.381382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:06.398959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:06.400072 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:06.401257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:06.401257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:06.401257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:06.401257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:06.401257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 607/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:06.406641 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.501923 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:06.504769 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03475b5-f025-4a04-ac90-eab7cb35de21 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.539168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.539168 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.539455 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.539566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.540252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:06.540600 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:06.541966 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:06.555943 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 604/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:06.562038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.666009 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4749-c720-4eef-8a16-284f576acebd None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.667523 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:06.699956 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.701372 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.701654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.701935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] PATH_INFO: `/v3/users/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.708897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:06.712388 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:06.725409 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:06.726862 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:06.728454 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 608/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:06.732431 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.832830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4aa4f1-46b0-495e-8048-8936a30d517a None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:06.865334 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:06.865995 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:06.866278 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:06.866554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:06.867374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:06.867684 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:06.869162 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:06.886397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 605/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:06.892870 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:06.991338 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd25556-174e-42a3-876f-5f292361458b None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.026228 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.026884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.027174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.027460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.056574 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.095380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.095990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.193325 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 609/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:27:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 29 23:27:07.199306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:07.218237 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.299010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdeecba-182e-40c0-9fa8-3a415ba6c3f2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.332719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.333512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.333800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.334083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.344212 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.345778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:07.363426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:07.368895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:07.370172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:07.370172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:07.370172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:07.370172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:07.370172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 606/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:07.371897 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:07.432679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.470289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0103-70a6-4c0d-bc32-4108cd9d165c None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.504341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.505634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.505634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.505634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.506308 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:07.506626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.507999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.520445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 610/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:07.526127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:07.595706 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.626443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cb5e5-3b75-4137-ae1a-ab264c5cd4db None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.659967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.660813 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.661105 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.661387 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.668070 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.670692 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:07.684776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:07.686029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:07.687153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 607/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:07.692085 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:07.791713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced852b0-7453-45c7-8b29-3efa17cd1310 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.814544 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.825916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.827062 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.827355 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.827638 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.828446 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:07.835775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.835775 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948c917-a634-4e95-8fa7-82a4bca90d84 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.841427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 611/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:07.848169 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:07.945379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac9c3e-eaf5-428e-a1b8-1275e9d99e85 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:07.974213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:07.980011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:07.980736 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:07.981031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:07.981318 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:07.982151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=f4220b16e78c4ba6bb4677cc4002d2c9) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:07.982470 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:07.984028 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fe33e-ccc7-4452-bdbd-b9f52800468c None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:07.991488 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 608/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:27:07 2022] GET /identity/v3/role_assignments?user.id=f4220b16e78c4ba6bb4677cc4002d2c9&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:10.045189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b035-65dc-46cc-a1e5-f3e6383eea28 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.046299 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b035-65dc-46cc-a1e5-f3e6383eea28 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.046442 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b035-65dc-46cc-a1e5-f3e6383eea28 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.047758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 612/1220] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:10.053042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.053441 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.053624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.070593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:10.071919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:10.142148 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 609/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:10.167944 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b035-65dc-46cc-a1e5-f3e6383eea28 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:10.271024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b035-65dc-46cc-a1e5-f3e6383eea28 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:10.305081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:10.305824 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.306197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.306478 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.316787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:10.324751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:10.326104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:10.327688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 613/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:10.332912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:10.429562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd1edf-cb97-4633-afea-593c7c9798fd None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:10.453624 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:10.464031 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:10.464733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.465022 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.465304 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.466095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] RBAC: Adding query filter params (name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:10.466409 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:10.468430 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:10.476353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 610/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:10.482300 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:10.527266 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:10.583886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b362f-30b7-4446-b032-7f17eac16f1d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:10.617675 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:10.618468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.618760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.619065 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.630284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:10.631755 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:10.649702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:10.651015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:10.652121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:10.652121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:10.652121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:10.652121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:10.652121 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 614/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:10.656743 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:10.756308 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53409524-a71f-4000-bde6-546c1bd1cc59 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:10.789728 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:10.790373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.790657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.790936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.791649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:10.791956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:10.793364 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:10.805297 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 611/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:10.811652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:10.903926 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:10.910326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4579c-5078-4ed5-bae4-3f5bdd5150a1 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:10.943611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:10.944440 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:10.944758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:10.945046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] PATH_INFO: `/v3/users/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:10.951867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:10.953922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:10.967770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:10.969061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:10.970624 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 615/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:10.974847 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.022277 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:11.075048 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef1d7-3f20-425a-878f-02e90335d6d5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.109254 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.109926 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.110231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.110493 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.111324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:11.111672 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.113210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:11.130957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 612/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:11.136864 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.239357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3d777-e4b2-451b-975b-978b6011e764 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.272915 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.273722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.273997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.274386 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.285011 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.286486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:11.305433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:11.306696 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:11.307783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:11.307783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:11.307783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:11.307783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:11.307783 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 616/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:11.312555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.411099 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82262ead-b0c9-4da3-a1c7-0d1bc1c589f3 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.413507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:11.444880 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.445543 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.445859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.446141 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.446859 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:11.447174 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.448597 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:11.460309 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 613/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:11.466203 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.475652 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:11.567336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052dde0-9d29-4550-80b0-3374ba3ebd46 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.601106 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.602021 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.602310 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.602594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.609323 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.610774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:11.624576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:11.625625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:11.626753 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 617/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:11.631780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.734982 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc1596-b28b-42bc-9d7f-443b07035057 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.770675 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.771343 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.771635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.771919 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.772774 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:11.773117 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.774562 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b07a1-6af8-414c-a291-a393a2f55fb6 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:11.787346 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 614/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:11.793167 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:11.858945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:11.894139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97db945-119e-437f-8b33-af62eb3d24ca None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:11.927935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:11.929002 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] REQUEST_METHOD: `PUT` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:11.929765 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:11.930052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/f4220b16e78c4ba6bb4677cc4002d2c9/roles/1d851834591f4153ada12343e6808807` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:11.944226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=f4220b16e78c4ba6bb4677cc4002d2c9, role_id=1d851834591f4153ada12343e6808807)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:11.945750 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d09cd0-5851-4a91-8e33-1740e81f3fd2 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:12.027163 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 618/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:27:11 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/f4220b16e78c4ba6bb4677cc4002d2c9/roles/1d851834591f4153ada12343e6808807 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:27:14.036575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2d23-439e-4792-a503-db2c2ff71b0c None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.037142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2d23-439e-4792-a503-db2c2ff71b0c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.037142 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b2d23-439e-4792-a503-db2c2ff71b0c None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.038528 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 615/1233] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:14.044074 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.046242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.046242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.063235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:14.064471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:14.131351 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 619/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:14.155503 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2d23-439e-4792-a503-db2c2ff71b0c None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:14.181397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:14.257818 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b2d23-439e-4792-a503-db2c2ff71b0c None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:14.292344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:14.293120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.293411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.293694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.304201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:14.311990 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:14.313209 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:14.314230 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 616/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:14.319568 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:14.365573 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:14.417763 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ca6bd-912d-4ce9-a0ee-3ce90bb059d5 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:14.453015 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:14.453678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.453961 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.454240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.455099 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] RBAC: Adding query filter params (name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:14.455408 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:14.456830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:14.464626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 620/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:14.470337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:14.555628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:14.571730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a330-9ac3-4fc6-a407-d2560c7a8e3b None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:14.605253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:14.606124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.606436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.606732 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.619628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:14.619628 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:14.637719 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:14.638883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:14.640565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:14.640565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:14.640565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:14.640565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:14.640565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 617/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:14.645122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:14.743903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc2fb8-2f96-45a2-a9fe-175025d371eb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:14.753346 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:14.777396 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:14.778053 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.778339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.778621 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.779336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:14.779641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:14.781067 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:14.792578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 621/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:14.798823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:14.897915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d7bf-b763-4d69-9069-e881547e21b7 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:14.932794 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:14.933589 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:14.933873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:14.934151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] PATH_INFO: `/v3/users/placement` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:14.937512 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:14.941936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:14.943373 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:14.957927 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:14.964465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:14.965643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 618/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:14.966380 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:15.064520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1d8e6-247c-4188-a5c6-e0d91dd60ee7 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:15.099060 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:15.099741 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:15.100032 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:15.100313 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:15.101230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:15.101545 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:15.102980 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:15.120990 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 622/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:15.126920 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:15.231773 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f40dc-06a3-4cf2-aa75-c01a3ffb7323 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:15.265860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:15.266531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:15.266913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:15.267195 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:15.327426 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:15.333964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:15.335491 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:15.433949 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 619/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:27:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:27:15.440023 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:15.469612 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:15.547024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de543b4-3880-451f-8bbd-95eca1a45969 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:15.581035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:15.581847 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:15.582134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:15.582417 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:15.593945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:15.595415 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:15.614594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:15.615946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:15.617194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:15.617194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:15.617194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:15.617194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:15.617194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 623/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:27:15.621640 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:15.715661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:15.722119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c95ce-df04-466f-8dd9-82c1da403dab None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:15.755983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:15.756688 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:15.756975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:15.757254 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:15.757973 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:15.758283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:15.759753 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:15.772384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 620/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:27:15.778151 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:15.857358 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:15.878867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d49840-f7fc-4481-bf61-8e5737578010 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:15.913528 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:15.914339 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:15.914626 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:15.914905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:15.921733 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:15.923223 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:15.937514 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:15.938758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:15.940049 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 624/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:15.944698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:16.045077 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f3083-d65a-4b10-983a-4cd185682ddd None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:16.080885 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:16.081560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:16.081851 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:16.082135 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:16.083083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:16.083337 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:16.084817 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699ff36-d50d-401e-9add-be85cec6fe2e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:16.097296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 621/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:16.103549 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:16.208841 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0141a-e7bd-45c6-ae85-a618b80bd1eb None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:16.244195 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:16.244907 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:16.245237 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:16.245502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:16.246333 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] RBAC: Adding query filter params (role.id=1d851834591f4153ada12343e6808807, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=f4220b16e78c4ba6bb4677cc4002d2c9) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:16.246719 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:16.248194 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eaeb95-b345-4ff7-ac13-a605e29cf645 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:16.254892 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 625/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:27:16 2022] GET /identity/v3/role_assignments?user.id=f4220b16e78c4ba6bb4677cc4002d2c9&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=1d851834591f4153ada12343e6808807 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:18.379186 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233f6c-b747-48c7-af1f-2b4052c3c268 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:18.379735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233f6c-b747-48c7-af1f-2b4052c3c268 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:18.379735 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a233f6c-b747-48c7-af1f-2b4052c3c268 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:18.381108 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 622/1247] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:18.386562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:18.386976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:18.387137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:18.392268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:18.404586 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:18.405805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:18.473235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 626/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:18.497730 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a233f6c-b747-48c7-af1f-2b4052c3c268 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:18.516531 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:18.605892 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a233f6c-b747-48c7-af1f-2b4052c3c268 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:18.641593 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:18.641868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:18.641984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:18.642275 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:18.653090 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:18.661017 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:18.662319 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:18.663757 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 623/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:18.668240 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:18.766952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca1e7a-178f-4063-a646-316bc24dc8a5 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:18.796927 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:18.804538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:18.804538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:18.804538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:18.804538 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:18.804976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:18.804976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:18.805701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:18.813976 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 627/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:27:18.819806 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:18.904507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:18.935082 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb03c2-d247-418f-aebd-bf296aa2a135 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:18.969375 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:18.970172 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:18.970458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:18.970738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:18.988618 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:18.990085 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:19.007125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:19.009079 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:19.010291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:19.010291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:19.010291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:19.010291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:19.010291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 624/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:19.014321 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:19.115229 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a92a3-e33e-4688-a704-e7c188b85c3a None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:19.148972 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:19.149704 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:19.149995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:19.150277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:19.151439 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:19.151758 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:19.153174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.166058 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 628/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:19.171766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:19.270969 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e475f9e-e9d2-4df9-8fa4-9f9f70562d5e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:19.296235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:19.303797 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:19.304656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:19.304941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:19.305219 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] PATH_INFO: `/v3/users/placement` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:19.312429 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:19.316535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:19.328151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:19.329505 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:19.330941 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 625/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:19.335324 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:19.391258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:19.434422 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49b3d1-ff8f-4590-81ef-82390b9e7b7e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:19.467037 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:19.468310 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:19.468627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:19.468908 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:19.469746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:19.470063 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:19.471520 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.488201 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 629/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:19.494127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:19.593127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbda03-c0f8-49c8-a56e-b464aa890024 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:19.629044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:19.629801 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:19.630095 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:19.630381 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:19.685120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:19.697613 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:19.704808 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.798601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 626/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:27:19.804421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:19.907166 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7ed8-e033-48ad-8a16-91ebbccdb4df None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:19.921515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:19.942466 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:19.943209 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:19.943546 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:19.943827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:19.953585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:19.955020 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:19.972141 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:19.977148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:19.978587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:19.978587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:19.978587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:19.978587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:19.978587 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 630/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:19.979471 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:20.065495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:20.077160 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546de2-4d2a-49e7-ac37-9c4f95a52114 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:20.111151 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:20.111821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:20.112110 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:20.112392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:20.113138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:20.113450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:20.114815 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:20.126463 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 627/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 29 23:27:20.132222 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:20.234277 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecd75d-7e96-4a01-a5f4-83abec5b8072 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:20.267840 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:20.268935 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:20.269231 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:20.269517 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:20.276397 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:20.277903 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:20.302297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:20.303563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:20.304995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 631/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:20.309553 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:20.407984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfbc56-23ed-4628-bcd5-78eab933d587 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:20.443138 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:20.443807 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:20.444103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:20.444392 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:20.445211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:20.445532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:20.447003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b06f93-7bbf-4573-bca4-87c03dd57ad9 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:20.459080 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 628/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:20.465287 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:20.492722 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:20.565601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787105ec-a94a-46bb-a999-d030fde710ee None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:20.604111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:20.604796 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:20.605083 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:20.605363 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:20.606187 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=f4220b16e78c4ba6bb4677cc4002d2c9) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:20.606502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:20.607983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda5539-48f8-4faa-b6d6-083765a74a5a None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:20.613329 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 632/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:27:20 2022] GET /identity/v3/role_assignments?user.id=f4220b16e78c4ba6bb4677cc4002d2c9&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:22.619293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b793c-9984-4146-bd2e-be6cee8428e5 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:22.619844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b793c-9984-4146-bd2e-be6cee8428e5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:22.619844 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b793c-9984-4146-bd2e-be6cee8428e5 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:22.621280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 629/1261] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:22.626736 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:22.627174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:22.627315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:22.644291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:22.645503 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:22.710625 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 633/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:22.734839 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b793c-9984-4146-bd2e-be6cee8428e5 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:22.745891 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:22.836235 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b793c-9984-4146-bd2e-be6cee8428e5 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:22.871021 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:22.871760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:22.872044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:22.872324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:22.882560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:22.890703 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:22.891989 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:22.893787 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 630/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:22.898357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:22.917474 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:22.995027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5695b8-4da1-4bf5-a4a0-ac269d6c566b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.029106 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.030334 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.030617 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.030896 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] PATH_INFO: `/v3/roles` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.031645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:23.031953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.033354 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.041368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 634/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:23.047310 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.112953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:23.145592 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518d15c-1a8e-4b71-b9b7-e8cf29b3a166 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.177744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.178540 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.178830 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.179115 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.189673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.191127 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:23.208932 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:23.215003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:23.225636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:23.225636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:23.225636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:23.225636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:23.225636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 631/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:27:23.226033 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.299084 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:23.317825 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c15244-b7ce-4969-92d7-c5dd80026664 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.350867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.351529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.351817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.352098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.352851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:23.353162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.354567 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.365670 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 635/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:23.371642 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.471356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b559d74-8e6f-4025-89bc-46e3b4024e05 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.490536 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:23.504656 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.505462 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.505750 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.506029 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] PATH_INFO: `/v3/users/placement` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.513332 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.515353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:23.530016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:23.531378 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:23.532673 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 632/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:27:23.537362 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.644191 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0571b67f-6c71-4fbe-8ca6-d195ec0485af None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.678509 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.679188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.679486 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.679770 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] PATH_INFO: `/v3/users` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.680716 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:23.681027 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.682471 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.692157 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:23.700048 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 636/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:23.705886 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.805765 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f54e7-b614-4baa-97a6-2db0529d327d None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:23.839468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:23.840289 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:23.840601 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:23.840883 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:23.851354 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:23.852860 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:23.870167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:23.872636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:23.874551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:23.874551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:23.874551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:23.874551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:23.874551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 633/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:23.878001 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:23.976213 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b045c25-30e8-4a0e-ade0-6626fded4a37 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:24.009665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:24.014622 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:24.024419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 637/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:24.030720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:24.062895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:24.130933 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46dd0d4-05c0-44ae-b9f4-9970b0de4979 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:24.163981 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:24.164821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:24.165106 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:24.165386 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:24.172491 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:24.173938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:24.189443 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:24.190778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:24.192086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 634/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:24.196525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:24.254466 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:24.294698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce65b0-3a90-4da8-bfda-4c182f403103 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:24.329590 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:24.330269 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:24.330558 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:24.330830 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:24.331613 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:24.331923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:24.333453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23532d6-4b2e-4388-b62f-f67c5f79d13e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:24.345235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 638/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:24.351198 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:24.442002 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:24.450546 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926e21f-17dd-408a-8f35-e11917a8bbf2 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:24.483770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:24.484895 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] REQUEST_METHOD: `PUT` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:24.485360 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:24.485984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] PATH_INFO: `/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/f4220b16e78c4ba6bb4677cc4002d2c9/roles/d47785af145640e9b0d7553f25d48899` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:24.487917 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user_id=f4220b16e78c4ba6bb4677cc4002d2c9, role_id=d47785af145640e9b0d7553f25d48899)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:24.489461 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c4f8a-67b7-4a27-b9d5-e695de0e91e0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:24.569712 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 635/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Wed Jun 29 23:27:24 2022] PUT /identity/v3/projects/3a6bd4a2c80d45bf90d1acb7ab4016ac/users/f4220b16e78c4ba6bb4677cc4002d2c9/roles/d47785af145640e9b0d7553f25d48899 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 29 23:27:26.588044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f39-1e4f-4fb0-aa35-1e508dc19362 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:26.588634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f39-1e4f-4fb0-aa35-1e508dc19362 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:26.588634 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534f39-1e4f-4fb0-aa35-1e508dc19362 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:26.590052 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 639/1274] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:26.595785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:26.596203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:26.596358 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:26.613073 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:26.614270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:26.683509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 636/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:26.708030 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534f39-1e4f-4fb0-aa35-1e508dc19362 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:26.808230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8534f39-1e4f-4fb0-aa35-1e508dc19362 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:26.825175 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:26.843920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:26.844705 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:26.844999 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:26.845284 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:26.855882 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 29 23:27:26.863601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:26.864940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:26.866137 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 640/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Wed Jun 29 23:27:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:26.870852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:26.949559 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:26.967960 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb05fb-8ffa-4334-85fa-7da2dcdad5d0 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.001038 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.001723 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.002013 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.002301 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] PATH_INFO: `/v3/roles` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.003055 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:27.003370 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.004780 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.013042 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 637/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Wed Jun 29 23:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:27.019537 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:27.119867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbfdb-0959-4957-aa80-477a1054b947 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.155654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.156490 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.156785 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.157068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.167540 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.169038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:27.186473 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:27.187709 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:27.189278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:27.189278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:27.189278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:27.189278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:27.189278 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 641/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:27.193473 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:27.293657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3416ad-2422-480c-ae9b-0f7e48b86d51 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.327916 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.328705 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.333779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.333779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] PATH_INFO: `/v3/domains` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.333779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:27.333779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.333779 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.343756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 638/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:27.349526 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:27.381506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:27.449111 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650df6bb-e2d2-4875-8a3b-c92343002d4d None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.488350 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.489244 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.489533 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.489812 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] PATH_INFO: `/v3/users/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.496849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.498290 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 29 23:27:27.513938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:27.517096 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:27.518754 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 642/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:27.521333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:27.525227 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:27.619691 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8725b-4ebc-469a-a2bc-cd39c8ed6075 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.653638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.654249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.654535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.654840 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] PATH_INFO: `/v3/users` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.655667 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:27.655978 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.657427 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.675323 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 639/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:27.681207 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:27.770044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:27.779245 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c8906-8b60-42ce-8af4-bee8239b592f None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:27.813125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:27.813773 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:27.814062 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:27.814341 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:27.881421 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:27.882902 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:27.969667 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:27.979576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 643/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 29 23:27:27.986131 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:28.047599 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:28.087023 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad5835-7f11-4677-9ae9-8aad81c4dd67 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:28.121702 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:28.122500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:28.122784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:28.123059 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:28.133517 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:28.134996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 29 23:27:28.152940 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:28.154184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:28.156312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 29 23:27:28.156312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 29 23:27:28.156312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 29 23:27:28.156312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:28.156312 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 640/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Wed Jun 29 23:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:28.160357 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:28.261945 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93802d20-37c0-43b6-8400-b6ab00dc9bb6 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:28.296957 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:28.297627 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:28.297917 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:28.298205 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] PATH_INFO: `/v3/domains` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:28.298925 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:28.299239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:28.300693 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:28.316603 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 644/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Wed Jun 29 23:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:28.317615 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:28.420344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16739f1-9191-4141-9955-0b71c8481627 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:28.433968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:28.454010 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:28.454819 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:28.455113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:28.455402 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] PATH_INFO: `/v3/projects/service` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:28.462111 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:28.463584 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 29 23:27:28.478689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:28.479922 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: ERROR keystone.server.flask.application Jun 29 23:27:28.481270 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 641/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Wed Jun 29 23:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:28.486085 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:28.537940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:28.586751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72754-35bb-4f26-8dac-1f271931f460 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:28.619654 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:28.620315 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:28.620637 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:28.620922 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] PATH_INFO: `/v3/projects` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:28.621706 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:28.622022 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:28.623949 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52134a74-30fb-4311-aea0-0f18ae86cdc9 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:28.635713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 645/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Wed Jun 29 23:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:28.642598 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:28.746225 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7307af-41dc-4788-9102-f877f785b41e None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:28.782878 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:28.783529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:28.783820 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:28.784103 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:28.784974 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] RBAC: Adding query filter params (role.id=d47785af145640e9b0d7553f25d48899, scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac, user.id=f4220b16e78c4ba6bb4677cc4002d2c9) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:28.785291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:28.786738 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1153859-83a4-451d-9b97-42971307db98 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:28.792552 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 642/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Wed Jun 29 23:27:28 2022] GET /identity/v3/role_assignments?user.id=f4220b16e78c4ba6bb4677cc4002d2c9&scope.project.id=3a6bd4a2c80d45bf90d1acb7ab4016ac&role.id=d47785af145640e9b0d7553f25d48899 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:30.861804 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653b8-4448-42cd-ac84-8cb1d706cb19 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:30.862436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653b8-4448-42cd-ac84-8cb1d706cb19 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:30.862436 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5653b8-4448-42cd-ac84-8cb1d706cb19 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:30.863740 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 646/1288] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:30.868904 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:30.869356 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:30.869568 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:30.886720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:30.887915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:30.917324 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:30.954062 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 643/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:30.977504 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5653b8-4448-42cd-ac84-8cb1d706cb19 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:31.079006 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5653b8-4448-42cd-ac84-8cb1d706cb19 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:31.089502 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:31.113813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:31.114562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:31.114849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:31.115128 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] PATH_INFO: `/v3/services/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:31.115786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:31.117180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:31.129641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:31.133488 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:31.134665 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 647/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:27:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:31.137083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:31.236109 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c202f-7b71-44cc-8485-da6a8fe472b6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:31.271096 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:31.271804 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:31.272091 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:31.272372 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:31.273148 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] RBAC: Adding query filter params (name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:31.273458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:31.274845 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0a894-58f6-4593-b89e-5d905a22e506 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:31.280177 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 644/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:27:31 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:31.285996 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:31.384046 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81cdd8-9617-4652-866a-b794a3da573e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:31.417585 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:31.418249 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:31.418539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:31.418817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] PATH_INFO: `/v3/services` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:31.419522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] RBAC: Adding query filter params (type=placement) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:31.419880 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:31.421312 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4d2f9-c0da-48ef-b2e6-c47c4eba40ae None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:31.425701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 648/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:27:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:33.487665 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bdb54-192f-4bf9-b9c2-1328421029af None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:33.488185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bdb54-192f-4bf9-b9c2-1328421029af None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:33.488185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29bdb54-192f-4bf9-b9c2-1328421029af None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:33.489565 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 645/1293] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:33.494818 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8b1c-4f85-46b7-ba09-ef1e12e2dd67 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:33.495235 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8b1c-4f85-46b7-ba09-ef1e12e2dd67 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:33.498297 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd8b1c-4f85-46b7-ba09-ef1e12e2dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:33.511925 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-54dd8b1c-4f85-46b7-ba09-ef1e12e2dd67 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:33.513148 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-54dd8b1c-4f85-46b7-ba09-ef1e12e2dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:33.543122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:33.579014 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 649/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:33.602967 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bdb54-192f-4bf9-b9c2-1328421029af None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:33.633638 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:33.704032 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29bdb54-192f-4bf9-b9c2-1328421029af None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:33.737353 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:33.738116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:33.738351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:33.738657 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:33.739383 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:33.740782 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2c42c-9cca-48d6-af13-ce9839bc6e5f None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:33.822938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 646/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Wed Jun 29 23:27:33 2022] POST /identity/v3/services => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 29 23:27:35.870701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3535-50d8-41b5-bf71-0d8ed5a58c07 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:35.871289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3535-50d8-41b5-bf71-0d8ed5a58c07 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:35.871289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b3535-50d8-41b5-bf71-0d8ed5a58c07 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:35.872688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 650/1296] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:35.878694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:35.879093 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:35.881689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:35.896124 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:35.897344 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:35.970256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 647/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 29 23:27:35.994368 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3535-50d8-41b5-bf71-0d8ed5a58c07 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:36.098968 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b3535-50d8-41b5-bf71-0d8ed5a58c07 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:36.133642 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:36.134382 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:36.134672 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:36.134956 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] PATH_INFO: `/v3/services/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:36.135615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:36.137031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:36.149131 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:36.150347 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:36.151712 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 651/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:27:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 29 23:27:36.156841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:36.176171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:36.255316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa37cb4-88cf-42d3-99bd-fe6cda4f673f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:36.288574 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:36.289248 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:36.289733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:36.290243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:36.291607 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:36.291928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:36.293348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:36.299126 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 648/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:27:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:36.305162 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:36.336905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:36.405649 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649f396-b2c7-4baf-9d87-40b6e820e277 None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:36.439986 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:36.440676 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:36.440971 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:36.441258 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:36.442051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] RBAC: Adding query filter params (interface=public, service_id=458d393d6cab4e32bb006855bfd3834d, region_id=RegionOne) {{(pid=285931) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:36.442374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:36.443751 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd41c-63b3-46ff-8fb3-bb05b2eca63d None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:36.448798 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 652/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Wed Jun 29 23:27:36 2022] GET /identity/v3/endpoints?service_id=458d393d6cab4e32bb006855bfd3834d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:36.455100 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:36.540351 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:36.558217 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e72ccb-c0f3-46a2-bebe-8383fa247ca5 None admin] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:36.592564 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:36.593238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:36.593529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:36.593809 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:36.594496 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:36.595894 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7123-8658-460c-893c-89b98158b786 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:36.602659 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 649/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Wed Jun 29 23:27:36 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 29 23:27:38.640506 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94869-9fb0-4fb0-b10f-acccb402d37a None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:38.641127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94869-9fb0-4fb0-b10f-acccb402d37a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:38.641127 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab94869-9fb0-4fb0-b10f-acccb402d37a None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:38.642461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 653/1302] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:27:38.647875 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:38.651208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:38.651208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:38.664976 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:27:38.666165 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:27:38.732171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 650/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:27:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 29 23:27:38.756537 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94869-9fb0-4fb0-b10f-acccb402d37a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:38.851239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:38.857760 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab94869-9fb0-4fb0-b10f-acccb402d37a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:38.892681 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:38.893424 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:38.893987 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:38.894335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] PATH_INFO: `/v3/services/placement` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:38.895061 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:38.896460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 29 23:27:38.910679 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 29 23:27:38.912314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.get_or_create( Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application with Lock( Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self._enter() Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application return self.creator() Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application created_value = creator( Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 29 23:27:38.913713 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: ERROR keystone.server.flask.application Jun 29 23:27:38.916576 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 654/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Wed Jun 29 23:27:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 29 23:27:38.917915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:38.992384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:39.015520 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd759f-f7a0-4c80-8939-6c2e495fa8d7 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:39.048223 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:39.048953 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:39.049224 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:39.049507 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] PATH_INFO: `/v3/services` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:39.050213 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=285932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 29 23:27:39.050529 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:39.051959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351b079-ff9f-4af1-90a6-47b11236f2f0 None admin] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:39.056983 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 651/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Wed Jun 29 23:27:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 29 23:27:39.063340 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:27:39.163479 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd39cd1-60cf-4cd8-bd85-8ef906c6c43e None admin] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:27:39.196291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f47b2146194815a01965579698893d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:27:39.196982 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:27:39.197445 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:27:39.197586 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:27:39.198316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:27:39.199688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b742a8-d74b-4d7b-8a72-019f01f27a73 None admin] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:27:39.325427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 655/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Wed Jun 29 23:27:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 29 23:27:49.084458 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=30 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:27:49.319846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:17.638044 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6367c9-be73-4563-9457-bd72014a5907 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:17.638635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6367c9-be73-4563-9457-bd72014a5907 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:17.638921 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6367c9-be73-4563-9457-bd72014a5907 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:17.646568 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccd03-c0a5-4706-a72a-99580997c9f5 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:17.647081 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccd03-c0a5-4706-a72a-99580997c9f5 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:17.647189 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccd03-c0a5-4706-a72a-99580997c9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:17.650763 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 652/1307] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:17.774904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-085ccd03-c0a5-4706-a72a-99580997c9f5 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:17.776146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-085ccd03-c0a5-4706-a72a-99580997c9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:17.922477 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 656/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:34:17.987525 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:17.988361 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:17.988925 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:17.990698 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 653/1309] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 23:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:17.998097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435db3-3672-4b5c-97c4-a970142f514c None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:17.998469 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435db3-3672-4b5c-97c4-a970142f514c None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:17.998686 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3435db3-3672-4b5c-97c4-a970142f514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:18.111611 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-e3435db3-3672-4b5c-97c4-a970142f514c None None] MFA Rules not processed for user `d0d463df72ab4f539c4eb5670aadcee6`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:18.113161 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e3435db3-3672-4b5c-97c4-a970142f514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:18.136604 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:18.217516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 657/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 23:34:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:18.218872 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:18.220810 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:18.407414 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907b94f-3e23-4dc0-89bd-64139fecc8c1 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:18.568776 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:18.571006 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:18.571518 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:18.572266 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:18.579355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:18.736535 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:18.882938 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:18.884560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637fe8b-2b8f-4ade-a0d4-9a90ba247d96 service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:18.928541 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 654/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 29 23:34:21.533451 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869fd1-06c7-4ad2-aad1-faa5fdb53718 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:21.534035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869fd1-06c7-4ad2-aad1-faa5fdb53718 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:21.534035 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869fd1-06c7-4ad2-aad1-faa5fdb53718 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:21.535385 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 658/1312] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:21.540636 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5397a-ed68-4690-859a-1018b92c70a1 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:21.541046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5397a-ed68-4690-859a-1018b92c70a1 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:21.541214 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5397a-ed68-4690-859a-1018b92c70a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:21.617081 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-caa5397a-ed68-4690-859a-1018b92c70a1 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:21.618334 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-caa5397a-ed68-4690-859a-1018b92c70a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:21.722468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 655/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:21.777288 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:21.777662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:21.777952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:21.779336 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 659/1314] 10.222.0.16 () {54 vars in 964 bytes} [Wed Jun 29 23:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:21.785435 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db711e9-cd0e-438d-b4bc-932d63208597 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:21.785729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db711e9-cd0e-438d-b4bc-932d63208597 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:21.786011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db711e9-cd0e-438d-b4bc-932d63208597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:21.797037 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:21.861655 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-6db711e9-cd0e-438d-b4bc-932d63208597 None None] MFA Rules not processed for user `d0d463df72ab4f539c4eb5670aadcee6`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:21.862861 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-6db711e9-cd0e-438d-b4bc-932d63208597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:21.940260 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 656/1315] 10.222.0.16 () {58 vars in 1061 bytes} [Wed Jun 29 23:34:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:21.950174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:21.951786 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:22.057766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6109677-8eec-4662-bdb3-79af9506fcda None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:22.129952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:22.132534 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:22.133188 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:22.133608 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:22.133893 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:22.135939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:22.245276 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:22.246645 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84285a0-5857-489a-ac81-657e851192d3 service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:22.264774 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 660/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:24.997841 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:24.998423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:24.998423 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:25.000374 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 657/1317] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:25.005489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1abb-cc5c-4d10-a693-bd33ec20b9d3 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:25.005934 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1abb-cc5c-4d10-a693-bd33ec20b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:25.006138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1abb-cc5c-4d10-a693-bd33ec20b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:25.069838 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-337e1abb-cc5c-4d10-a693-bd33ec20b9d3 None None] MFA Rules not processed for user `e69a95399e314f24bd40d95c9769572a`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:25.071031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-337e1abb-cc5c-4d10-a693-bd33ec20b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:25.126251 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:25.170242 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 661/1318] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:25 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:25.210415 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:25.212283 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:25.314411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3409a8-027a-40ee-ba34-c56f7753961f None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:25.317152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:25.386524 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:25.387173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:25.387457 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:25.387784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:25.389550 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:25.498790 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:25.500228 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3825db-c374-4608-babe-120b8a9477e8 service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:25.518403 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 658/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:28.350539 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:28.351109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:28.351109 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:28.352507 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 662/1320] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:28.357733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b1a7-5b45-4b45-bf3a-4f372c75ff56 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:28.358696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b1a7-5b45-4b45-bf3a-4f372c75ff56 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:28.358905 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495b1a7-5b45-4b45-bf3a-4f372c75ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:28.401472 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:28.427107 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-1495b1a7-5b45-4b45-bf3a-4f372c75ff56 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:28.428368 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-1495b1a7-5b45-4b45-bf3a-4f372c75ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:28.523800 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 659/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:28.563568 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:28.565289 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:28.671051 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1f64d-b307-43ea-b56f-dd644c4f9149 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:28.745252 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:28.745904 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:28.746197 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:28.746481 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:28.748199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:28.755239 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:28.860031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:28.861522 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803a3ad-d7a1-4826-a5b4-124e96e8583e service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:28.879802 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 663/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:31.954998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:31.955557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:31.955557 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:31.956999 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 660/1323] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:31.962184 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ce5-efad-425a-8134-b10685548021 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:31.962606 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ce5-efad-425a-8134-b10685548021 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:31.962826 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756ce5-efad-425a-8134-b10685548021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:32.029064 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-e7756ce5-efad-425a-8134-b10685548021 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:32.030302 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-e7756ce5-efad-425a-8134-b10685548021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:32.087833 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:32.133600 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 664/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:32.171170 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:32.172784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:32.285193 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc9d39-8a31-4467-8391-b85aee303abf None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:32.298408 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:32.362173 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:32.362836 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:32.363125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:32.363405 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:32.365120 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:32.474306 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:32.475762 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30fd06-f613-44bf-b549-a7093362b8ff service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:32.495016 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 661/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:34.609993 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:34.610529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:34.610529 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:34.611868 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 665/1326] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:34.617548 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6db2-0f52-4654-bc11-56b504f88946 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:34.619118 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6db2-0f52-4654-bc11-56b504f88946 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:34.619478 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f6db2-0f52-4654-bc11-56b504f88946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:34.672821 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:34.692210 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-613f6db2-0f52-4654-bc11-56b504f88946 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:34.693483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-613f6db2-0f52-4654-bc11-56b504f88946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:34.792887 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 662/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:34.828973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:34.831646 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:34.936494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fc794-7499-4067-a226-79b011cd56f6 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:35.010953 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:35.011598 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:35.011885 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:35.012164 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:35.014494 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:35.031263 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:35.123596 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:35.125104 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520fb00-6f8b-4d9f-82e3-fc596a514af4 service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:35.143683 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 666/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:37.245509 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:37.246051 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:37.246157 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:37.247477 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 663/1329] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:37.252641 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc50ca-7f8f-437f-b0d8-eda68eff9bbd None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:37.253068 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc50ca-7f8f-437f-b0d8-eda68eff9bbd None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:37.253192 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc50ca-7f8f-437f-b0d8-eda68eff9bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:37.318224 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-d8fc50ca-7f8f-437f-b0d8-eda68eff9bbd None None] MFA Rules not processed for user `e69a95399e314f24bd40d95c9769572a`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:37.319461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-d8fc50ca-7f8f-437f-b0d8-eda68eff9bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:37.389653 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:37.414268 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 667/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:34:37.453250 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:37.454799 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:37.558171 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827053-d16e-4b01-87f4-559c2f20f7c6 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:37.579280 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:37.632595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:37.633253 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:37.633542 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:37.633825 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:37.635468 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:37.748153 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:37.749560 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc7302-025e-4078-9cd3-05f9755a68fc service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:37.767595 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 664/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:40.441296 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:40.441881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:40.441881 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:40.443257 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 668/1332] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:40.448532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ea37-6a6c-4ce9-b1a3-41a21819bc0e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:40.448957 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ea37-6a6c-4ce9-b1a3-41a21819bc0e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:40.449113 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ea37-6a6c-4ce9-b1a3-41a21819bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:40.511770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:40.514700 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-46f4ea37-6a6c-4ce9-b1a3-41a21819bc0e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:40.515906 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-46f4ea37-6a6c-4ce9-b1a3-41a21819bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:40.612644 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 665/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:40.648995 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:40.650867 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:40.754937 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0da9a-d6fd-4e78-a8f2-80999cf5cbde None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:40.827335 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:40.827979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:40.828267 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:40.828578 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:40.830215 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:40.857198 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:40.937256 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:40.938698 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d9c5e-14e5-43d0-bd2e-60de316a5850 service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:40.957123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 669/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:43.048857 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:43.049456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:43.049456 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:43.050823 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 666/1335] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:43.055983 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c029-530e-46f2-b2d3-c549c7f1113e None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:43.056427 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c029-530e-46f2-b2d3-c549c7f1113e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:43.056594 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c029-530e-46f2-b2d3-c549c7f1113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:43.121457 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-7062c029-530e-46f2-b2d3-c549c7f1113e None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:43.122688 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-7062c029-530e-46f2-b2d3-c549c7f1113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:43.198811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:43.221437 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 670/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:43.261766 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:43.263316 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:43.365733 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3edd9-3fee-4974-a8b7-dd100d64ad11 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:43.393411 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:43.439125 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:43.439778 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:43.440071 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:43.440355 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:43.442045 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:43.549203 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:43.550648 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9113b0f-c0bd-4d82-bb71-dcd07993307e service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:43.568763 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 667/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:46.163456 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:46.163989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:46.164094 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:46.165433 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 671/1338] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:46.171086 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336ebd9-0391-4e6c-b16e-e0704327f4d2 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:46.171513 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336ebd9-0391-4e6c-b16e-e0704327f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:46.171635 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336ebd9-0391-4e6c-b16e-e0704327f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:46.237952 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-5336ebd9-0391-4e6c-b16e-e0704327f4d2 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:46.239184 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-5336ebd9-0391-4e6c-b16e-e0704327f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:46.247510 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:46.334370 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 668/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:46.370931 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:46.372524 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:46.480595 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedbc905-3d6a-4ff4-a84f-204118dacedc None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:46.554199 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:46.554851 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:46.555139 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:46.555419 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:46.557097 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:46.593017 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:46.666563 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:46.668044 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4801137-7dbd-40c0-a0e7-3dda805ce2cb service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:46.686746 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 672/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:51.016428 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:51.017011 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:51.017181 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:51.020436 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 669/1341] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:51.023816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61ae-d9e5-4841-bc21-37eb6c16fa5b None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:51.024562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61ae-d9e5-4841-bc21-37eb6c16fa5b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:51.024662 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d61ae-d9e5-4841-bc21-37eb6c16fa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:51.101734 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-a04d61ae-d9e5-4841-bc21-37eb6c16fa5b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:51.103031 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-a04d61ae-d9e5-4841-bc21-37eb6c16fa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:51.201909 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=100 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:51.214817 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 673/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:51.254315 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:51.256532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:51.351575 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a68d67-72d5-4222-8a32-f691154c54d4 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:51.355293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:51.355955 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:51.356246 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:51.356569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:51.366175 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:51.367694 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72876-032a-4a84-aec5-f571ea6642df service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:51.377705 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 670/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:54.401464 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:54.401947 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:54.402697 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:54.403415 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 674/1344] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:54.409045 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fa81-ebe4-46b2-8e59-9acc6ede5367 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:54.409495 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fa81-ebe4-46b2-8e59-9acc6ede5367 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:54.409610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0fa81-ebe4-46b2-8e59-9acc6ede5367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:54.440256 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-23f0fa81-ebe4-46b2-8e59-9acc6ede5367 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:54.441500 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-23f0fa81-ebe4-46b2-8e59-9acc6ede5367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:54.469816 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:34:54.519439 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 671/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:54.558281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:54.560214 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:54.573291 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1e9ea-0e4f-471c-b3bd-33a00ddb3d0a None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:54.576886 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:54.577708 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:54.578117 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:54.578460 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:54.587829 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:54.589525 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796e1e3-b9a5-4c72-ab13-291ec870b061 service neutron] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:54.599337 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 675/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:34:59.251190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963926-8515-4897-ba96-8d9915f22e58 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:59.251759 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963926-8515-4897-ba96-8d9915f22e58 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:59.252074 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3963926-8515-4897-ba96-8d9915f22e58 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:59.253551 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 672/1347] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:34:59.259125 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3bf38-aa19-4feb-bc0c-16026bba7006 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:59.259621 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3bf38-aa19-4feb-bc0c-16026bba7006 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:59.259762 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3bf38-aa19-4feb-bc0c-16026bba7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:59.279243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-86e3bf38-aa19-4feb-bc0c-16026bba7006 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:34:59.280489 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-86e3bf38-aa19-4feb-bc0c-16026bba7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:34:59.288633 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 676/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:34:59.327870 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3963926-8515-4897-ba96-8d9915f22e58 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:34:59.338937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3963926-8515-4897-ba96-8d9915f22e58 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:34:59.342571 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0d463df72ab4f539c4eb5670aadcee6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:34:59.343243 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:34:59.343649 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:34:59.343942 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:34:59.353772 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:34:59.355244 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691257d-8c15-45a1-9bf5-f47644999c58 service neutron] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:34:59.365959 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 673/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:04.474813 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad3f-5a08-45ed-ac4a-c8158e9f500b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:04.475328 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad3f-5a08-45ed-ac4a-c8158e9f500b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:04.475447 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceaad3f-5a08-45ed-ac4a-c8158e9f500b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:04.476766 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 677/1350] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:04.482404 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d1b6-fabb-48ec-a256-68d33a7279b7 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:04.482848 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d1b6-fabb-48ec-a256-68d33a7279b7 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:04.482962 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d1b6-fabb-48ec-a256-68d33a7279b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:04.582783 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-2576d1b6-fabb-48ec-a256-68d33a7279b7 None None] MFA Rules not processed for user `f4220b16e78c4ba6bb4677cc4002d2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:04.584252 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-2576d1b6-fabb-48ec-a256-68d33a7279b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:04.708018 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 674/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:35:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:09.131584 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b27fe-394d-46e3-941c-8a5017ec2136 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:09.132485 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b27fe-394d-46e3-941c-8a5017ec2136 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:09.132938 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b27fe-394d-46e3-941c-8a5017ec2136 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:09.134761 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 678/1352] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:09.140391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4eda-1061-41ee-b7c4-e5ff3fc6d9a0 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:09.140868 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4eda-1061-41ee-b7c4-e5ff3fc6d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:09.140996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf4eda-1061-41ee-b7c4-e5ff3fc6d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:09.160998 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-00bf4eda-1061-41ee-b7c4-e5ff3fc6d9a0 None None] MFA Rules not processed for user `f4220b16e78c4ba6bb4677cc4002d2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:09.162303 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-00bf4eda-1061-41ee-b7c4-e5ff3fc6d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:09.171068 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 675/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:35:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:09.273038 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=13 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:35:10.672998 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c52-22ce-4b7c-9aff-8b95762bba53 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:10.673671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c52-22ce-4b7c-9aff-8b95762bba53 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:10.673671 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e73c52-22ce-4b7c-9aff-8b95762bba53 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:10.674940 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 679/1354] 10.222.0.16 () {54 vars in 921 bytes} [Wed Jun 29 23:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:10.679968 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720c18-fc30-46ab-80f8-4806a5b835e5 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:10.680391 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720c18-fc30-46ab-80f8-4806a5b835e5 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:10.680770 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4720c18-fc30-46ab-80f8-4806a5b835e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:10.700295 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-e4720c18-fc30-46ab-80f8-4806a5b835e5 None None] MFA Rules not processed for user `f4220b16e78c4ba6bb4677cc4002d2c9`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:10.701591 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-e4720c18-fc30-46ab-80f8-4806a5b835e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:10.710132 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 676/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Wed Jun 29 23:35:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:35:14.142180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839ff1-0f21-4bfc-86f0-8da4a551bf16 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:14.142180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839ff1-0f21-4bfc-86f0-8da4a551bf16 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:14.142180 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd839ff1-0f21-4bfc-86f0-8da4a551bf16 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:14.143122 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 680/1356] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:14.154158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9baa-d0d5-49cf-a97e-93b3993ceb31 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:14.154996 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9baa-d0d5-49cf-a97e-93b3993ceb31 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:14.158201 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b9baa-d0d5-49cf-a97e-93b3993ceb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:14.177881 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-598b9baa-d0d5-49cf-a97e-93b3993ceb31 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:14.182158 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-598b9baa-d0d5-49cf-a97e-93b3993ceb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:14.187412 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 677/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:14.251552 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219835-040f-484d-b659-ac7d07b7650b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:14.251845 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219835-040f-484d-b659-ac7d07b7650b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:14.254767 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e219835-040f-484d-b659-ac7d07b7650b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:14.258747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 681/1358] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 23:35:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:14.265862 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d021-8c79-499c-9de7-19b8c346f94c None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:14.270333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d021-8c79-499c-9de7-19b8c346f94c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:14.270333 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3d021-8c79-499c-9de7-19b8c346f94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:14.337527 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:35:14.348785 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-00c3d021-8c79-499c-9de7-19b8c346f94c None None] MFA Rules not processed for user `38c9321d65fa472fb58ed69d3fa5c42d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:14.349954 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-00c3d021-8c79-499c-9de7-19b8c346f94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:14.463083 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 678/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 23:35:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:35:14.471515 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219835-040f-484d-b659-ac7d07b7650b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:14.487013 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e219835-040f-484d-b659-ac7d07b7650b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:14.492661 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:14.493314 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:14.493601 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:14.493884 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:14.503034 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:14.504724 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c371-b490-414a-9979-31d8fc1d33e0 service nova] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:14.515010 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 682/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:16.812789 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c293f-d67f-4828-b111-420975bd194c None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:16.813621 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c293f-d67f-4828-b111-420975bd194c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:16.813908 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c293f-d67f-4828-b111-420975bd194c None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:16.815293 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 679/1361] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:16.820728 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379d97-872a-403f-8e83-925af1e55575 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:16.821145 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379d97-872a-403f-8e83-925af1e55575 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:16.821737 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18379d97-872a-403f-8e83-925af1e55575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:16.840516 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-18379d97-872a-403f-8e83-925af1e55575 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:16.841979 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-18379d97-872a-403f-8e83-925af1e55575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:16.851120 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 683/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:16.896384 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c293f-d67f-4828-b111-420975bd194c None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:16.910729 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c293f-d67f-4828-b111-420975bd194c None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:16.916185 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:16.916873 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:16.917159 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:16.917440 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:16.926325 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:16.927935 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d8aeb-9104-4b37-b44c-bf99f1682eb0 service nova] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:16.938501 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 680/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:19.467134 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d29c9-6731-4eea-b37a-8a2eabf2d4ff None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:19.468738 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d29c9-6731-4eea-b37a-8a2eabf2d4ff None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:19.469398 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d29c9-6731-4eea-b37a-8a2eabf2d4ff None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:19.472123 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 684/1364] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:19.489889 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448eec0-9734-4259-84a4-7a529fe11dc9 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:19.491121 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448eec0-9734-4259-84a4-7a529fe11dc9 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:19.491579 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448eec0-9734-4259-84a4-7a529fe11dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:19.514150 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-3448eec0-9734-4259-84a4-7a529fe11dc9 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:19.515352 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-3448eec0-9734-4259-84a4-7a529fe11dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:19.523238 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 681/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:19.573954 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6e89-d46c-4223-b3bf-87c6ab0e588b None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:19.574274 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6e89-d46c-4223-b3bf-87c6ab0e588b None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:19.575132 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee6e89-d46c-4223-b3bf-87c6ab0e588b None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:19.576659 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 685/1366] 10.222.0.16 () {54 vars in 961 bytes} [Wed Jun 29 23:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:19.581975 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54d717-ce2f-4e8f-a254-6975b795219e None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:19.582274 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54d717-ce2f-4e8f-a254-6975b795219e None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:19.582563 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54d717-ce2f-4e8f-a254-6975b795219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:19.601731 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-ce54d717-ce2f-4e8f-a254-6975b795219e None None] MFA Rules not processed for user `38c9321d65fa472fb58ed69d3fa5c42d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:19.602929 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-ce54d717-ce2f-4e8f-a254-6975b795219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:19.612576 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 682/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Wed Jun 29 23:35:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:35:19.620303 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6e89-d46c-4223-b3bf-87c6ab0e588b None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:19.634805 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee6e89-d46c-4223-b3bf-87c6ab0e588b None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:19.640831 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:19.641472 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:19.641769 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:19.642054 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:19.650330 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:19.651923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda89725-b98c-4e5f-bf2c-8b60617d5898 service nova] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:19.661915 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 686/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:21.953775 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a700-efb1-4be2-bc8e-fdd5181ad848 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:21.954379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a700-efb1-4be2-bc8e-fdd5181ad848 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:21.954379 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24a700-efb1-4be2-bc8e-fdd5181ad848 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:21.955725 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 683/1369] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:21.961410 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4602-6d45-4e87-bd0c-fa54f072b42f None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:21.961852 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4602-6d45-4e87-bd0c-fa54f072b42f None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:21.961978 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af4602-6d45-4e87-bd0c-fa54f072b42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:21.979868 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-30af4602-6d45-4e87-bd0c-fa54f072b42f None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:21.981747 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-30af4602-6d45-4e87-bd0c-fa54f072b42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:21.990138 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 687/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:22.034583 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a700-efb1-4be2-bc8e-fdd5181ad848 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:22.052532 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24a700-efb1-4be2-bc8e-fdd5181ad848 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:22.058465 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:22.060003 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:22.060670 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:22.061190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:22.070050 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:22.072147 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508906e-a7b3-4b6c-acac-7e8eac3c1316 service nova] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:22.082784 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 684/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:22.577916 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c83e-7eb2-406d-ab51-9697f4db4967 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:22.578212 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c83e-7eb2-406d-ab51-9697f4db4967 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:22.578723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1c83e-7eb2-406d-ab51-9697f4db4967 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:22.580098 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 688/1372] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:22.585450 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c51a2-7e7f-4fed-9257-f58a01691d52 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:22.585956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c51a2-7e7f-4fed-9257-f58a01691d52 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:22.586416 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c51a2-7e7f-4fed-9257-f58a01691d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:22.604964 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-425c51a2-7e7f-4fed-9257-f58a01691d52 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:22.606475 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-425c51a2-7e7f-4fed-9257-f58a01691d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:22.614487 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 685/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 29 23:35:22.974827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700160-192d-441d-aa44-f41a05a0a201 None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:22.974827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700160-192d-441d-aa44-f41a05a0a201 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:22.974827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab700160-192d-441d-aa44-f41a05a0a201 None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:22.974827 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 689/1374] 10.222.0.16 () {54 vars in 963 bytes} [Wed Jun 29 23:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:22.978852 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c0c7-162c-492c-ac24-f2ce3e87f510 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:22.979313 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c0c7-162c-492c-ac24-f2ce3e87f510 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:22.979483 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389c0c7-162c-492c-ac24-f2ce3e87f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:23.029913 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-f389c0c7-162c-492c-ac24-f2ce3e87f510 None None] MFA Rules not processed for user `ddf6bbbc36f74a3da54ee118b2dcfd23`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:23.031116 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-f389c0c7-162c-492c-ac24-f2ce3e87f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:23.099915 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 686/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Wed Jun 29 23:35:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:23.107873 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab700160-192d-441d-aa44-f41a05a0a201 None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:23.118702 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab700160-192d-441d-aa44-f41a05a0a201 None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:23.122723 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddf6bbbc36f74a3da54ee118b2dcfd23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:23.123362 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:23.123648 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:23.123923 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:23.133147 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:23.134619 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ee931-0ec5-47cc-8e82-9cc99d18fd6e service cinder] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:23.146395 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 690/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:24.307231 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda32-ce53-49f8-8506-70bbd645078c None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:24.307760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda32-ce53-49f8-8506-70bbd645078c None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:24.307760 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bda32-ce53-49f8-8506-70bbd645078c None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:24.309152 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 687/1377] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:24.314390 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66f50-22d4-4bcd-8b3c-584c569af8a8 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:24.314846 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66f50-22d4-4bcd-8b3c-584c569af8a8 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:24.314959 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66f50-22d4-4bcd-8b3c-584c569af8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:24.332920 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-a4e66f50-22d4-4bcd-8b3c-584c569af8a8 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:24.334116 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-a4e66f50-22d4-4bcd-8b3c-584c569af8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:24.342701 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 691/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:24.386194 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bda32-ce53-49f8-8506-70bbd645078c None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:24.401521 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bda32-ce53-49f8-8506-70bbd645078c None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:24.407669 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:24.408318 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:24.408643 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:24.408928 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:24.417119 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:24.418744 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfef58-b937-4a18-92e0-608a9b19fa3b service nova] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:24.423349 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=100 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:35:24.429630 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 688/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:26.673326 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5965c83-64e8-40fa-b3b8-d82b275af4ed None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:26.673843 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5965c83-64e8-40fa-b3b8-d82b275af4ed None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:26.673973 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5965c83-64e8-40fa-b3b8-d82b275af4ed None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:26.675264 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 692/1380] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:26.680569 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19542a-e4d7-48e2-9769-6c767568793b None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:26.681046 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19542a-e4d7-48e2-9769-6c767568793b None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:26.681167 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19542a-e4d7-48e2-9769-6c767568793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:26.698984 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-0d19542a-e4d7-48e2-9769-6c767568793b None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:26.700710 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-0d19542a-e4d7-48e2-9769-6c767568793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:26.708555 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 689/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:26.753905 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5965c83-64e8-40fa-b3b8-d82b275af4ed None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:26.771159 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5965c83-64e8-40fa-b3b8-d82b275af4ed None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:26.784952 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:26.786849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:26.786849 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:26.787040 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:26.796294 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:26.797946 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c58786-d2fb-4d10-9d06-8e5788a07157 service nova] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:26.807628 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 693/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:29.003291 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ce45-f6b7-4b1c-89f7-907c4b13efd8 None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:29.003856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ce45-f6b7-4b1c-89f7-907c4b13efd8 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:29.003856 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ce45-f6b7-4b1c-89f7-907c4b13efd8 None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:29.005208 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 690/1383] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:29.010562 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389417-ab6d-4387-8d45-4b3352c39399 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:29.010989 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389417-ab6d-4387-8d45-4b3352c39399 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:29.011146 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68389417-ab6d-4387-8d45-4b3352c39399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:29.030241 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-68389417-ab6d-4387-8d45-4b3352c39399 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:29.031470 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-68389417-ab6d-4387-8d45-4b3352c39399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:29.039692 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 694/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:29.082936 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062ce45-f6b7-4b1c-89f7-907c4b13efd8 None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:29.101026 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062ce45-f6b7-4b1c-89f7-907c4b13efd8 None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:29.107295 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:29.107950 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:29.108464 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:29.108756 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:29.118345 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:29.119963 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7f9b5-ee3a-4a3d-a3d2-ff2bd9ffc794 service nova] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:29.131211 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 691/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:31.191316 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b82c-e4e5-4c72-ba4d-51fe7d48279d None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:31.191888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b82c-e4e5-4c72-ba4d-51fe7d48279d None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:31.191888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b82c-e4e5-4c72-ba4d-51fe7d48279d None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:31.193318 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 695/1386] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:31.198610 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de20cc-023f-4203-bdca-929a8a62bdf9 None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:31.199566 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de20cc-023f-4203-bdca-929a8a62bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:31.199689 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de20cc-023f-4203-bdca-929a8a62bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:31.218720 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-98de20cc-023f-4203-bdca-929a8a62bdf9 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:31.219912 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-98de20cc-023f-4203-bdca-929a8a62bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:31.227937 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 692/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:31.272811 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b82c-e4e5-4c72-ba4d-51fe7d48279d None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:31.295374 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b82c-e4e5-4c72-ba4d-51fe7d48279d None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:31.300963 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:31.301615 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:31.301941 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:31.302226 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:31.311174 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:31.312816 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713d98a-999e-4139-ab89-4b3b38aa78b1 service nova] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:31.322453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 696/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:33.013348 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3108-9c63-4650-82cb-48f84d0d530d None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.013956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3108-9c63-4650-82cb-48f84d0d530d None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.013956 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3108-9c63-4650-82cb-48f84d0d530d None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.015296 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 693/1389] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:33.020452 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664097d0-aedd-4357-955b-c68ba207b508 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.020888 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664097d0-aedd-4357-955b-c68ba207b508 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.021024 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664097d0-aedd-4357-955b-c68ba207b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.039461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-664097d0-aedd-4357-955b-c68ba207b508 None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:33.040678 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-664097d0-aedd-4357-955b-c68ba207b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:33.049453 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 697/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:33.105661 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083525-be9c-44e3-9baa-de93c93f30bb None None] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.105960 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083525-be9c-44e3-9baa-de93c93f30bb None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.106249 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3083525-be9c-44e3-9baa-de93c93f30bb None None] PATH_INFO: `/` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.107633 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 694/1391] 10.222.0.16 () {54 vars in 962 bytes} [Wed Jun 29 23:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:33.112636 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362840f0-fb05-4263-b8c8-54cea8f7acb1 None None] REQUEST_METHOD: `POST` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.112939 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362840f0-fb05-4263-b8c8-54cea8f7acb1 None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.113230 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362840f0-fb05-4263-b8c8-54cea8f7acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.162025 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.auth.core [None req-362840f0-fb05-4263-b8c8-54cea8f7acb1 None None] MFA Rules not processed for user `66f4f677a3fa4e1791d2525a6f0d3574`. Rule list: `[]` (Enabled: `True`). {{(pid=285931) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:33.163243 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.fernet_utils [None req-362840f0-fb05-4263-b8c8-54cea8f7acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285931) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:33.225200 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 698/1392] 10.222.0.16 () {58 vars in 1059 bytes} [Wed Jun 29 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:33.232931 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3083525-be9c-44e3-9baa-de93c93f30bb None None] Authenticating user token {{(pid=285932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:33.243958 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3083525-be9c-44e3-9baa-de93c93f30bb None None] Validating token access rules against request {{(pid=285932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:33.248146 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66f4f677a3fa4e1791d2525a6f0d3574', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:33.251094 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] REQUEST_METHOD: `GET` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.251094 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.251094 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.259199 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:33.260677 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfa228-cbcc-4d8c-9374-408251475e04 service glance] RBAC: Authorization granted {{(pid=285932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:33.270908 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 695/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:33.483582 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544b6-5c14-44be-9081-e84c6799371e None None] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.483997 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544b6-5c14-44be-9081-e84c6799371e None None] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.484293 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b544b6-5c14-44be-9081-e84c6799371e None None] PATH_INFO: `/` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.485778 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 699/1394] 10.222.0.16 () {54 vars in 926 bytes} [Wed Jun 29 23:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 29 23:35:33.491803 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea57e-3c0c-42ee-b958-d51e90ad731f None None] REQUEST_METHOD: `POST` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.492112 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea57e-3c0c-42ee-b958-d51e90ad731f None None] SCRIPT_NAME: `/identity` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.492397 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ea57e-3c0c-42ee-b958-d51e90ad731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=285932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.512190 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.auth.core [None req-f86ea57e-3c0c-42ee-b958-d51e90ad731f None None] MFA Rules not processed for user `28f47b2146194815a01965579698893d`. Rule list: `[]` (Enabled: `True`). {{(pid=285932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 29 23:35:33.513587 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG keystone.common.fernet_utils [None req-f86ea57e-3c0c-42ee-b958-d51e90ad731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=285932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 29 23:35:33.521914 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: [pid: 285932|app: 0|req: 696/1395] 10.222.0.16 () {58 vars in 1023 bytes} [Wed Jun 29 23:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 29 23:35:33.566743 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b544b6-5c14-44be-9081-e84c6799371e None None] Authenticating user token {{(pid=285931) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 29 23:35:33.582059 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b544b6-5c14-44be-9081-e84c6799371e None None] Validating token access rules against request {{(pid=285931) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 29 23:35:33.587468 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c9321d65fa472fb58ed69d3fa5c42d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a6bd4a2c80d45bf90d1acb7ab4016ac', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=285931) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 29 23:35:33.588126 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] REQUEST_METHOD: `GET` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 29 23:35:33.588461 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] SCRIPT_NAME: `/identity` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 29 23:35:33.588787 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=285931) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 29 23:35:33.597281 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 29 23:35:33.598868 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187108a-1391-43e5-a4ab-ab8c828ebb24 service nova] RBAC: Authorization granted {{(pid=285931) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 29 23:35:33.608375 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: [pid: 285931|app: 0|req: 700/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Wed Jun 29 23:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 29 23:35:43.563554 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: DEBUG dbcounter [-] [285932] Writing DB stats keystone:SELECT=22 {{(pid=285932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:35:43.730776 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: DEBUG dbcounter [-] [285931] Writing DB stats keystone:SELECT=89 {{(pid=285931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 23:35:59.405371 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: Wed Jun 29 23:35:59 2022 - graceful shutdown triggered... Jun 29 23:35:59.405511 dv-cinder-812685-13-iscsi systemd[1]: Stopping Devstack devstack@keystone.service... Jun 29 23:35:59.406169 dv-cinder-812685-13-iscsi devstack@keystone.service[285931]: Gracefully killing worker 1 (pid: 285931)... Jun 29 23:35:59.406696 dv-cinder-812685-13-iscsi devstack@keystone.service[285932]: Gracefully killing worker 2 (pid: 285932)... Jun 29 23:36:00.407317 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: worker 1 buried after 1 seconds Jun 29 23:36:00.407317 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: worker 2 buried after 1 seconds Jun 29 23:36:00.407317 dv-cinder-812685-13-iscsi devstack@keystone.service[285920]: goodbye to uWSGI. Jun 29 23:36:00.408786 dv-cinder-812685-13-iscsi systemd[1]: devstack@keystone.service: Succeeded. Jun 29 23:36:00.409334 dv-cinder-812685-13-iscsi systemd[1]: Stopped Devstack devstack@keystone.service.